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SECTION  I 
INTRODUCTION 


1.  OBJECTIVES  AND  STATUS  OF  THE  RE¬ 
SEARCH 

This  annual  report  describes  the  results  obtained  during  the  second  year  of 
the  project  directed  towards  the  analysis  of  fundamental  bounds  on  the  maximal 
achievable  precision  of  aiming  of  dynamical  systems  with  random  disturbances 
and  application  of  these  bounds  to  control  of  space  structures.  The  specific 
goals  of  the  second  year  of  the  study  were  as  follows:  Conduct  research  into  and 
uncover  the  fundamental  properties  of  the  following  topics: 

1.  State  and  output  aiming  controllers  with  output  feedback:  analysis  and 
design. 

2.  Aiming  controllers  with  noisy  measurement:  fundamental  tradeoffs. 

3.  Residence  proability  control  vs.  residence  time  control:  analysis  and  syn¬ 
thesis. 

These  goals  have  been  achieved  and  the  results  are  reported  in  Sections  II-III 
below.  The  summary  of  the  results  is  as  follows: 

Section  II  is  devoted  to  analysis  of  residence  time  control  processes  using  the 
dynamic  output  feedback.  The  main  conclusions  arrived  at  in  this  study  are: 
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1.  The  linear  system 


dx  =  (Ax  +  Bu)dt  4-  eCdw  ,  x(0)  =  xq 
y  -  Dx  ,  (1.1) 

where  x  G  Rn,  u  £  Rm,  y  £.  Rp,  w  is  a  standard  r-dimensional  Brownian  motion 
and  0<f  <  1,  with  the  noiseless  output  feedback 

u  =  Kx 

x  =  Ax  -+■  Bu  +  L(z  -  Ex)  ,  z  —  Ex  ,  z  £  Rq  ,  (1.2) 

is  pointable  with  any  desired  residence  time  if  and  only  if  it  is  invertible  and 
minimum  phase  in  an  appropriate  sense. 

2.  If  it  is  not  the  case,  the  maximal  achievable  residence  time  T*  <  oo  for 
system  (1.1),  (1.2)  coincides  with  that  for  system  with  state  feedback,  u  =  Kx , 
if  and  only  if  E(sl  —  A)'lC  is  left  invertible  and  minimum  phase;  otherwise, 
the  output  controllers  give  a  smaller  residence  time  in  comparison  with  the  state 
space  controllers. 

3.  The  residence  time  of  system  (1.1)  with  noisy  output  feedback 

u  —  Kx 

dx  =  (Ax  4-  Bu)dt  4-  L(dz  -  Exdt)  (1.3) 

dz  =  Exdt  4-  eFdwi  , 

where  wi(t)  is  a  ^-dimensional  standard  Brownian  motion,  is  always  bounded, 
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T*  <  co.  Thus,  the  measurement  noise  has  a  more  severe  effect  on  the  residence 
time  than  the  input  noise. 

4.  The  observer  gain  L  that  ensures  the  largest  possible  residence  time  in 
system  (1.1),  (1.3)  coincides  with  that  of  the  corresponding  Kalman  filter.  Thus, 
Kalman  filter  is  optimal  not  only  with  respect  to  the  standard  performance  mea¬ 
sure,  i.e.,  the  mean  square  estimation  error,  but  also  from  the  point  of  view  of 
the  residence  time. 

5.  The  feedback  gain  K  that  ensures  the  largest  possible  residence  time  in 
system  (1.1),  (1.3)  is  dependent  on  the  optimal  value  of  L  mentioned  above. 
Thus,  although  the  separation  principle  does  not  take  place,  the  situation  here 
can  be  characterized  as  semi-separation:  the  optimal  observations  do  not  depend 
on  optimal  control  but  the  optimal  control  does  depend  on  optimal  observations. 
As  a  result,  the  maximal  achievable  residence  time  for  controllers  derived  in  this 
paper  is  larger  than  that  for  LQG-designed  systems. 

Section  III  is  devoted  to  the  formulation,  justification,  and  solution  of  the 
residence  probability  control  problem  and  to  the  introduction  and  analysis  of  the 
notion  of  (£?,  Testability.  Specifically,  if 

rZn  =  inf {t  >  0  :  z(t)  €  dD\x0  e  [D0)}  ,  (1.4) 

(D  C  Rn  and  D0  C  D  are  open  bounded  domains  with  0  in  their  interiors)  is  the 
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first  passage  time  of  the  trajectory  of  (1.1)  with 


u  =  Kx  ,  (1.5) 

from  D,  than  the  problem  of  aiming  control  can  be  reformulated  in  the  two 
following  ways: 

Residence  time  control:  Given  (1.1)  and  a  pair  ( D,T ),  find  a  feedback  law 
(1.5)  and  an  open  set  D0  C  D  such  that 

E{tz„)  >  T  ,  Vx0€[£>o)  •  (1-6) 

Residence  proability  control.  Given  (1.1),  a  pair  ( D,T )  and  a  constant  0  < 
p  <  1,  find  a  feedback  law  (1.5)  and  an  open  set  D0  C  D  such  that 

Prob{rl(I  >  T}  >  p  ,  V  x0  €  [A>]  •  (1-7) 

The  residence  time  control  problem  (1.6)  and  its  generalizations  has  been 
analyzed  during  the  first  year  of  the  project  and  in  Section  II  of  this  report. 

The  residence  probability  control  (1.7)  appears  to  be  a  stronger  reformulation 
of  the  aiming  control  problem  than  the  residence  time  control.  Indeed,  since  rtn 
is  non-negative  random  variable,  the  Markov  inequality  gives: 

Prob{r,„  >  T}  <  . 

Therefore,  if  Prob(rt„  >T}  >p,  the  estimate  for  £[r,J  follows  immediately: 

EK)  >  pT  . 
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Moreover,  it  is  possible  to  show  that  for  any  D ,  D0,  T  and  0  <  p  <  1  there  exists 
a  feedback  law  (1.5)  and  Xo  €  D0  such  that  the  closed  loop  system  (1.1),  (1.5) 
has  the  following  property: 

E[fra\  >  T  , 

Prob{r*0  >T}  <  p  . 

This  implies  that  the  closed  loop  system  may  exhibit  a  performance  as  good  as 
desired  from  the  residence  time  point  of  view  and  as  bad  as  desired  from  the 
point  of  view  of  the  residence  probability. 

These  observations  justify  the  problem  of  residence  probability  control. 

The  results  obtained  in  Section  III  with  regard  to  the  residence  probability 
control  problem  can  be  summarized  as  follows: 

1.  The  residence  probability  control  gives  a  stronger  reformulation  of  the 
aiming  control  problem  than  the  residence  time  control.  However,  the  resulting 
control  problem  is  also  more  complex:  the  performance  depends  on  the  size  of 
the  initial,  “lock  in”,  domain  and  on  the  operating  period. 

2.  The  ( D ,  Testability  with  probability  p  is  a  useful  tool  for  characterization 
of  the  performance  of  stochastic  systems  with  no  equilibrium  points.  The  per¬ 
formance  in  terms  of  (D,  Testability  may  be  contradictory  to  the  performance 
in  terms  of  LQG  criterion. 

3.  The  residence  probability  of  a  controlled  linear  system  with  additive  white 
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noise  an  be  modified  in  any  desired  manner,  for  instance,  made  as  close  to  1  as 
desired,  if  and  only  if  the  range  space  of  the  noise  matrix  is  included  in  the  range 
space  of  the  control  matrix.  Otherwise,  the  achievable  residence  probability 
is  bounded  away  from  1  and  estimates  of  this  bound  are  characterized  herein 
(Section  III). 

2.  PROFESSIONAL  PERSONNEL 

ASSOCIATED  WITH  THE  PROJECT 

The  results  outlined  above  were  obtained  by  a  research  team  that  included: 

1.  Semyon  M.  Meerkov,  Professor,  Principal  Investigator. 

2.  Thordur  Runolfsson,  Post  Doctoral  Fellow  (August  1,  1988  -  January  15, 
1989).  Starting  from  January  16,  1989,  Dr.  Runolfsson  has  accepted  a  posi¬ 
tion  of  an  Assistant  Professor  in  the  Department  of  Electrical  and  Computer 
Engineering,  The  Johns  Hopkins  University,  Baltimore,  MD  21218. 

3.  Seungnam  Kim,  Doctoral  Candidate. 


3.  PAPERS  IN  THE  AREA  OF  THE  PROJECT 

(l).  A  paper  titled  “Theory  of  Residence  Time  Control  by  Output  Feedback”, 
by  S.M.  Meerkov  and  T.  Runolfsson  has  been  accepted  for  presentation  at  the 
28th  IEEE  CDC ,  Tampa,  FL,  Dec.  1989.  This  paper  comprises  Section  II  of  this 
report. 
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[2) .  A  paper,  “Theory  of  Aiming  Control  for  Linear  Stochastic  Systems”,  by 
S.  Meerkov  and  T.  Runolfsson  has  been  submitted  to  the  11th  IFAC  Congress, 
Tallinn,  U.S.S.R.,  Aug.  1990.  This  paper  is  included  as  an  Appendix  herewith. 

(3) .  A  paper,  “Aiming  Control:  Residence  Probability  and  (D, Testability, 
by  S.  Kim,  S.M.  Meerkov  and  T.  Runolfsson,  has  been  prepared  for  submission 
to  the  29th  IEEE  CDC.  This  paper  comprises  Section  III  of  this  report. 

[4j.  A  paper:  “Aiming  Control:  Design  of  Residence  Probability  Controllers” 
is  being  prepared  for  submission  to  the  29th  IEEE  CDC. 

[5].  A  paper,  “Output  Residence  Time  Control”  by  S.M.  Meerkov  and  T. 
Runolfsson  (reported  originally  in  the  Annual  Report  for  1987-1988)  is  to  appear 
in  the  IEEE  Trans.  Automat.  Contr..  The  galley  proofs  of  this  paper  are  included 
in  the  Appendix. 
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SECTION  n 


THEORY  OF  RESIDENCE  TIME  CONTROL 
BY  OUTPUT  FEEDBACK 


S.  M.  Meerkov 

Department  of  Electrical  Engineering 
and  Computer  Science 
The  University  of  Michigan 
Ann  Arbor,  MI  48109-2122 

and 


T.  Runolfsson 

Department  of  Electrical  and 
Computer  Engineering 
The  Johns  Hopkins  University 
Baltimore,  MD  21218 


Abstract 

The  problem  of  residence  time  control  by  the  observer  based  out¬ 
put  feedback  is  formulated  and  solved  for  the  case  of  linear  systems 
with  small  additive  input  noise.  Both  noiseless  and  noisy  measure¬ 
ments  are  considered.  In  the  noiseless  measurements  case,  it  is  shown 
that  the  fundamental  bounds  on  the  achievable  residence  time  de¬ 
pend  on  the  nonminimum  phase  zeros  of  the  system.  In  the  noisy 
measurements  case,  the  achievable  residence  time  is  shown  to  be  al¬ 
ways  bounded,  and  an  estimate  of  this  bound  is  given.  Controller 
design  techniques  are  presented.  The  development  is  based  on  the 
asymptotic  large  deviations  theory. 


This  work  has  been  enpported  by  the  Air  Force  Office  of  Scientific  Research  under  Contract 
F49620-87-C-0079.  The  United  States  Government  is  authorised  to  reproduce  and  distribute 
reprints  for  the  governmental  purposes  notwithstanding  any  copyright  notations  hereon. 
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1.  INTRODUCTION 


Consider  the  following  Ito  stochastic  system 

dx  =  (Ax  +  Bu)dt  +  iCdw 
V  =  Dx  ,  (1.1) 

where  x  6  12",  u  €  Rm,y  €  Rp,w(t)  is  a  standard  r-dimensional  Brownian  mo¬ 
tion,  A,B,C,D  are  matrices  of  appropriate  dimensionality,  and  0  <  e  <  1.  For  a 
given  a,  the  behavior  of  (1.1)  in  a  bounded  domain  9  C  Rp  can  be  characterized 
by  the  first  passage  time  [1], 

r*(u)  =  inf{t  >  0  :  y(t,u)  6  a«jy(0,u)  €  ¥}  , 

(39  is  the  boundary  of  ♦),  or  by  its  average  value 

f»  =  £[r»|  . 

The  r(u)  is  referred  to  as  the  (average)  residence  time  of  (1.1)  in  9. 

Assume  that  control  specifications  for  (1.1)  are  given  in  the  form  of  an  aiming 
(pointing)  problem:  maintain  y(t)  in  a  given  domain  9  C  Rp  during  a  specified 
time  interval  (0,jf),  T  <  oo.  In  terms  of  the  average  residence  time  this  problem 
has  the  form 

f‘(u)  >  T  .  (1.2) 
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Technical  examples  of  this  problem  can  be  found  in  [2j. 

To  accomplish  (1.2),  the  feedback  control  approach  can  be  utilized.  Papers  [2] 
and  [3]  address  this  problem  under  the  assumption  that  all  t  dates  x  are  available 
for  control  and  u  is  chosen  as 

u  =  Kx  .  (1.3) 

In  (2]  it  was  assumed  that  D  =  /,  i.e.  the  pointing  of  states  has  been  considered, 
and  in  [3]  the  general  case  of  output  aiming  has  been  analyzed.  It  has  been 
shown  that  from  the  point  of  view  of  satisfying  (1.2),  all  systems  (1.1)  can  be 
partitioned  into  two  groups:  weakly  and  strongly  residence  time  controllable. 
Roughly  speaking,  (1.1)  is  weakly  residence  time  controllable  (tart-controllable) 
if  there  exists  T*  <  oo  such  that  the  closed  loop  system  (1.1),  (1.3)  satisfies 
(1.2)  for  T  <  T*  and  some  K  and  does  not  satisfy  (1.2)  for  T  >  T'  and  any  K. 
System  (1.1)  is  strongly  residence  time  controllable  (art-controllable)  if  T*  =  oo. 
It  has  been  shown  in  [2]  that  (1.1)  with  D  =  /  is  tart-controllable  if  and  only 
if  (A,B)  is  stabilizable  and  srt-controllable  if  and  only  if  Im  C  C  Im  B.  It 
has  been  shown  in  (3]  that  system  (1.1)  tart-controilable  in  states  can,  in  fact,  be 
srt-controllable  in  outputs  y  /  x.  In  particular,  it  was  shown  that  a  SISO  system 
(1.1)  is  srt-controllable  if  and  only  if  all  non-minimum  phase  zeros  of  G,(s)  = 
D(aI  —  A)~lB  coincide  with  non-minimum  phase  zeros  of  Gn(s)  =  D(sl -  A)~lC. 
This  means,  of  course,  that  minimum  phase  plants  are  pointable  with  any  pre¬ 
cision  whereas  non-minimum  phase  ones  may  or  may  not  be,  depending  on  the 
location  of  the  right  half  plane  zeros  of  G„(s). 
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In  the  present  paper  we  address  problem  (1.2)  under  the  assumption  that  only 
(measured)  outputs  are  available  for  control  and,  therefore,  the  output  feedback 
has  to  be  utilized.  To  simplify  the  problem,  we  consider  here  the  observer  based 
output  feedback,  i.e.  controllers  of  the  form: 


u  =  Kx 

x=  Ax  4-  Bu  4-  L(z  —  Ex) 


(1.4) 


if  the  measured  output, 


z  =  Ex  ,  z  €  ft4  ,  Ee  Rqxn  , 


is  noise  free,  or 

u  =  Kx 

(1.5) 

dx  =  {Ax  4  Bu)dt  +  L(dz  -  E£dt) 
if  the  measured  output, 

dz  =  Exdt  4-  e  Fdw i  , 

is  noisy.  Here  u>i(t)  is  a  ^-dimensional  standard  Brownian  motion  and  0  <  e  <C  1. 
In  each  case,  (1.4)  and  (1.5),  the  problem  is  to  choose  the  pair  ( K,L )  so  that 
(1.2)  is  satisfied. 

To  this  end,  in  this  paper  we  derive  the  following  results: 

1.  System  (1.1)  with  feedback  (1.4)  is  srt-controllable  if  and  only  if  the  system 
is  invertible  and  minimum  phase  in  an  appropriate  sense. 
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2.  If  this  is  not  the  case,  the  maximal  achievable  residence  time  T *  for 
system  (1-1),  (1.4)  coincides  with  that  for  system  (1.1),  (1.3)  if  and  only  if 
Gn ,(s)  =  E(sl  -  A)~lC  is  left  invertible  and  minimum  phase;  otherwise  the 
output  controllers  lead  to  a  smaller  residence  time. 

3.  System  (1.1)  with  feedback  (1.5)  is  never  srt-controllable.  Thus,  the 
measurement  noise  has  a  much  more  severe  effect  on  the  residence  time  than  the 
input  noise. 

4.  The  observer  gain  L  that  ensures  the  largest  possible  residence  time  in 
system  (1.1),  (1.5)  coincides  with  that  of  the  corresponding  Kalman  filter.  Thus, 
Kalman  filter  is  optimal  not  only  with  respect  to  the  standard  performance  mea¬ 
sure,  i.e.,  the  mean  square  estimation  error,  but  also  from  the  point  of  view  of 
the  residence  time. 

5.  The  feedback  gain  K  that  ensures  the  largest  possible  residence  time  in 
system  (1.1),  (1.5)  is  dependent  on  the  optimal  value  of  L  mentioned  above. 
Thus,  although  the  separation  principle  does  not  take  place,  the  situation  here 
can  be  characterized  as  semi-separation:  the  optimal  observations  do  not  depend 
on  optimal  control  but  the  optimal  control  does  depend  on  optimal  observations. 
As  a  result,  the  Tns.Tims.1  achievable  residence  time  for  controllers  derived  in  this 
paper  is  larger  than  that  for  LQG-designed  systems. 

The  remainder  of  this  paper  is  organized  as  follows:  In  Section  2  some  mathe¬ 
matical  preliminaries  are  discussed.  In  Sections  3-5  system  (1.1)  with  controllers 
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(1.4)  and  (1.5),  respectively,  is  considered  and  in  Section  6  an  illustrative  exam¬ 
ple  is  given.  In  Section  7  the  conclusions  are  formulated.  The  proofs  are  given 
in  the  Appendix. 

2.  PRELIMINARIES 

In  this  section,  the  notion  of  logarithmic  residence  time,  i.e.,  the  main  tool 
of  asymptotic  analysis  of  (1.1)  with  (1.3)-(1.5),  is  introduced  and  utilized  for  a 
precise  formulation  of  problem  (1-2). 

Consider  the  linear  Ito  system 

dx  =  Axdt  +  e  Cdw 

y  -  Dx  (2.1) 

where,  as  before,  x  €  Rn,  y  €  Rp,w(t)  is  a  standard  r-dimensional  Brownian 
motion  and  0<e<l.  Let  ¥  C  Rp  be  again  a  bounded  domain  with  the  origin 
in  its  interior  and  a  smooth  boundary  d¥.  Define 

Oo  =  {*€«":  y  =  £>*€*}  ,  (2.2) 

0  =  {x  €  R"  :  Det'x  €  ¥,  t  >  0}  .  (2.3) 

Assume  that  z(0)  =  xo  €  flo  and  introduce  the  first  passage  time  as 

r'(xo)  =  inf  {t  >  0  :  y(t,x0)  €  5*}  ,  (2.4) 

where  y(t,x o)  is  the  solution  of  (2.1).  The  following  theorem  was  proved  in  (3). 
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Theorem  2.1:  Suppose  A  is  Hurwitz  and  (A,C)  is  disturb&ble,  i.e.  rank 
\C  AC . . .  An~lC\  =  n.  Then  uniformly  for  all  zo  belonging  to  compact  subsets 
of  fl  we  have: 

lime1  lnf*(xo)  =  /i  ,  (2.5) 


where,  as  before,  f‘(i0)  =  Ett)T*{x 0)  and 

ft  =  min  \yT  Ny  , 
ir€«*2 

N  =  (DXDt)-\  AX  +  XAt  +  CCT  =  0  . 


(2.6) 


Constant  jx  is  referred  to  as  the  logarithmic  residence  time  of  (2.1)  in  ¥. 


Let  j/(t,x<„Zoi  L)  be  the  solution  of  the  deterministic  system 


X 

A 

BK 

X 

x(0) 

Xo 

A 

X 

LE 

A  +  BK-LE 

£ 

i 

z(0) 

f 0 

y  =  Dx  (2.7) 

and  define 


n  (K,L)  = 


*0 

io 


fj{t,x0t2o,K,L)  €*,t>0 


(2.8) 


Then,  with  regard  to  control  system  (1.1)  and  controllers  (1.4)  or  (1.5),  The¬ 
orem  2.1  allows  ua  to  conclude  that  for  sufficiently  small  e  and  (*")  €  fi (K,L), 
problem  (1.2)  can  be  replaced  by  an  alternative  problem  of  selecting  the  pair 
( K ,  L)  such  that 

A(¥;ff,L)>M  (2.9) 
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where  £(¥;  K,  L)  is  the  logarithmic  residence  time  of  the  closed  loop  system  (1.1), 
(1.4)  or  (1.1),  (1.5)  and  n  =  €J  Ini’.  This  is  the  problem  solved  in  this  paper. 

As  it  was  pointed  out  in  the  Introduction,  the  solution  of  this  problem  is  given 
in  terms  of  the  weak  and  strong  residence  time  controllability  defined  precisely 
below.  In  order  to  simplify  the  notations,  we  drop  argument  ¥  in  (2.9). 

Definition  2.1:  (i)  System  (l.l)  is  called  weakly  residence  time  controllable 
if  for  any  bounded  domain  ¥  C  Rp(0  €  ¥)  there  exists  controller  (1.4)  (or  (1.5)) 
such  that  fi(K,  L)  >  0; 

(ii)  System  (1.1)  is  said  to  be  strongly  residence  time  controllable  if  for  any 
bounded  ¥  C  Rp{ 0  €  ¥)  and  n  >  0  there  exists  controller  (1.4)  (or  (1.5))  such 
that  ji(K ,  L)  >  /*. 

In  what  follows,  we  will  be  assuming  that: 

Al:  ( A,C )  is  disturbable, 

A2:  ( D ,  A)  is  detectable, 

A3:  FFt  >  0,  and  w(t)  and  Wi(f)  are  independent  Brownian  mo¬ 
tions, 

A4:  Transfer  matrices  G,(s)  =  D(al- A)~1B,Gn(s)  =  D(sI-A)~lC 
and  G„i(s)  =  E[al  -  A)~XC  have  full  normal  rank. 


is 


3.  NOISELESS  MEASUREMENTS  CASE 


Let  K  =  {K  e  Rmxn  :  A  +  BK  is  Hurwitz  },£  =  {£,  e  RnxP  :  A  -  LE  is 
Hurwitz  }  and  define  the  maximal  logarithmic  residence  time  of  (1.1),  (1.4)  or 
(1.1),  (1.5)  in  ¥  as 

A*  =  sup  A {K,L)  .  (3.1) 

KeK 

Lee 

Introduce  the  following  hypotheses: 

Hi:  G,(s)  is  right  invertible  and  minimum  phase. 

H2:  Gni  (s)  is  left  invertible  and  minimum  phase. 

H3:  There  exists  an  m  x  r  rational  matrix  U  (s)  with  no  poles  in  Re  s  >  0  such 
that  Gn{a)  +  G.(a)U{3)  =  0. 

H4:  There  exists  a  pxf  rational  matrix  V(a)  with  no  poles  in  Re  a  >  0  such 
that  G„(s)  +  V(s)Gwi(«)  =  0- 

Theorem  3.1:  System  (1.1)  is 

(i)  weakly  residence  time  controllable  by  controller  (1.4)  if  and  only  if  {A,B) 
is  stabilisable  and  (E,  A)  is  detectable, 

(ii)  strongly  residence  time  controllable  by  controller  (1.4)  if  and  only  if  (4,  B) 
is  stabilizable,  (E}  A)  is  detectable  and  either  Hi  and  H4  or  H2  and  H3  are 
satisfied. 
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Proof:  See  the  Appendix. 


Remark  S.l:  As  it  was  shown  in  [3],  H3  is  the  condition  for  strong  res¬ 
idence  time  controllability  with  respect  to  the  state  space  feedback  u  =  Kx. 
Furthermore,  HI  is  a  stronger  condition  than  H3.  Thus,  either  H4  or  H2  are 
the  additional  condition  that  has  to  be  satisfied  when  the  state  space  feedback 
is  replaced  by  the  output  feedback. 

Remark  3.2:  In  SISO  case  with  D  =  E,  Theorem  3.1  implies  that  for  strong 
residence  time  controllability  Gt(s)  should  be  minimum  phase. 

A  comparison  of  the  fundamental  bounds  on  the  residence  time  achievable  by 
state  space  (1.3)  and  output  (1.4)  feedback  can  be  given  as  follows: 

Consider  the  closed  loop  system  (1.1),  (1.3),  i.e. 

dx  =  (A  +  BK)xdt  +  c  Cdw  ,  (3.2) 

and  define  as 

H*  =supii('9]K)  (3.3) 

its  maximal  logarithmic  residence  time  in  ¥. 

Theorem  3.3:  Equality  A*  =  M*  takes  place  if  and  only  if  Cni(s)  has  a  left 
inverse  with  no  poles  in  Re  s  >  0. 

Proof:  See  the  Appendix. 
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4.  NOISY  MEASUREMENTS  CASE 


Theorem  4.1:  Let  P  be  the  unique  positive  definite  solution  of  the  (Kalman 
filter)  Riccati  equation: 

AP  +  PAt  +  CCt  -  PET{FFT)'lEP  =  0  .  (4.1) 

Then  the  maximal  logarithmic  residence  time  of  the  closed  loop  system  (1.1), 
(1.5)  in  9  satisfies  the  bound 

V  <  mm  i  yT(DPDT)~ly  .  (4.2) 

»es*  L 

Proof:  See  the  Appendix. 

Remark  4.1:  It  follows,  in  particular,  from  Theorem  4.1  that  since  the  upper 
bound  in  (4.2)  is  always  finite,  system  (1.1)  with  control  (1.5)  is  never  strongly 
residence  time  controllable.  Therefore,  the  measurement  noise  in  (1.5)  has  a 
greater  limiting  effect  on  the  achievable  residence  time  than  the  input  noise  in 
(1.1). 


Theorem  4.3:  The  upper  bound  (4.2)  is  attained  if  and  only  if  there  exists 
a  rational  matrix  W(s)  with  no  poles  in  Re  s  >  0  such  that 


G«(s)  +  G.(s)IP(«)  =  0  , 

(4.3) 

where  C7,(s)  is  defined  as  previously  and 

G,(s)  =  D{sl-A)~li  , 

(4.4) 

L  =  PEt{FFt)-'  . 

(4.5) 
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Proof:  See  the  Appendix. 


Remark  4.2:  Theorem  4.2  illustrates  that  the  upper  bound  in  (4.2)  is  at¬ 
tainable.  Therefore,  it  is  the  best  possible  upper  bound. 

5.  DESIGN  TECHNIQUES 

In  the  two  previous  sections  we  have  characterized  the  fundamental  bounds 
on  the  achievable  logarithmic  residence  time.  In  this  section  we  develop  the 
controller  design  techniques  that  achieve  these  bounds.  First  system  (1.1)  with 
control  (1.5)  is  considered  and  then  system  (1.1)  with  control  (1.4)  is  addressed. 
An  example  is  given  in  Section  6. 

To  select  the  pair  {K ,  L }  that  maximizes  /*( K,  L)  assume,  for  simplicity,  that 
domain  ¥  is  an  ellipsoid 

¥  =  {y  €  Rp  :  yTSV  <  r»,  5  =  ST  >  0}  .  (5.1) 

Let  W  €  R,Xf  be  a  nonsingular  matrix  such  that  S  =  WTW. 
calculations  we  obtain: 

*  I  TS  T\  r* 

A(tf,£)  =  2A m„[WDX(K,L)DTWT]  ’ 

where  X(K,L)  is  given  by 

A  BK  X{K,L)  T(K,  L) 

LE  A  +  BK-LE  ^(K^L)  X{K,L) 


Then  by  direct 

(5.2) 

(53) 
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[  X(K,L) 

T(K,L) 

A  BK 

T 

4- 

CCT  0 

X(K,L) 

LE  A  +  BK-LE 

I 

0  lfftlt 

Therefore,  the  pair  { K,L }  ia  optimal  if  and  only  if  it  minimizes  the  largest 
eigenvalue  of  T{K,L)  =  W  DX{K,L)DTWT .  The  Am4.(r)  can  be  characterized 
as  follows: 

Lemma  5.1:  Let  0  >  0  be  a  scalar,  l  >  1  be  an  integer  and  select  Ki  6  K 
and  Lj  €  £  such  that 

Tr  T{Ki,Li)1  <  (1  +  0)  inf{Tr  T(K,L)l\K  £  K,L  €  £}  .  (5.4) 


Then 

Urn  Am„(r(«-,,£,))  =  mf{Am„(r(/f,i))|K'  €  K,L  €  £.}  (5.5) 

Hoo 

Proof:  The  proof  of  this  lemma  is  similar  to  the  proof  of  Theorem  2.1  in  [7], 
We  omit  the  details  here. 

Thus,  in  order  to  minimize  AmkX(r),  we  need  only  to  minimize  Tr  T(K,  L)1,  l  = 
1,2,3...  .  To  accomplish  this,  introduce 

J!,{K,L)  =Trr(K,Ly  +7TV  KX(K,L)KT  ,  (5.6) 


where  %(K,L)  is  given  by  (5.3). 


Lemma  5.2:  Assume  that  K,7  €  K  and  L]  €  C  minimize  J\{K,L).  Then 


(5.7) 
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Proof:  The  proof  of  this  lemma  is  similar  to  the  first  part  of  the  proof  of  the 
Theorem  in  (4).  We  omit  the  details  here. 

From  Lemmas  5.1  and  5.2  follows: 

Corollary  5.1:  Assume  that  the  pair  with  K?  €  K  and  L~l  €  Z 

minimizes  J\{K,L).  Then 

Hm  lim  fi{K? ,  L])  =  jx  .  (5.8) 

Thus,  K?  and  L]  provide  the  solution  to  (3.1).  A  necessary  condition  for 
the  optimality  of  {K? ,  L])  in  the  sense  of  functional  (5.6)  can  be  formulated  as 
follows. 

Theorem  5.1:  Assume  that  K?  €  K  and  L]  €  Z.  Then  in  order  for  [K? ,L]) 


to  minimize  J‘(/f,L)  it  is  necessary  that 

Li  =  L  =  PEt(FFt)~1  ,  (5.9) 

*7  =  --  BTQl  ,  (5.10) 

where  P  is  given  by  (4.1)  and 

ATQ'l  +  Q]A  +  DtWtM?WD  -  i  Q]BBtQ]  =  0  ,  (5.11) 

M?  =  +  P)DTWT)l~l  ,  (5.12) 

(A  +  BK?)X?  +  X?(A+  BK?)T  +  ILT  =  0  .  (5.13) 

Proof:  See  the  Appendix. 
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Thus,  in  particular,  the  optimal  observation  gain  is  independent  of  optimal 
control  while  the  optimal  control  gain  is  a  function  of  optimal  observations. 

Since  (4.1)  has  a  positive  definite  solution,  V{  —  L  €  £,  V  7,/.  The  following 
lemma  gives  a  condition  for  K?  €  K. 

Lemma  5.3:  Assume  that  A/,"1  >  0.  Then  K?  6  K. 

Proof:  See  the  Appendix. 

Remark  5.1:  As  it  follows  from  Theorem  5.1,  the  optimal  estimator  gain  L 
given  in  (5.9)  is  the  Kalman  filter  gain.  Thus,  the  Kalman  filter  is  optimal  in 
optimization  problem  (3.1).  Moreover,  consider  the  equation  for  the  estimation 
error  e  =  x  -  x: 

de  =  (A  -  LE)dt  +  e  C  dw  -  e  LFdw\  (5.14) 

and  define  its  logarithmic  residence  time  in  any  domain  A  C  fi“(0  G  A)  as 
A(A;L).  Then 

£(A \L)  =  min  \  eTP~l[L)e  ,  (5.15) 

It 

where  P{L)  is  the  positive  definite  solution  of 

(A  -  LE)P{L)  +  P{L)(A  -  LE)t  +  CCT  +  LFFTLT  =  0  .  (5.16) 

Since  P  given  by  (4.1)  satisfies  the  inequality 

P<P{L),  VLe£  ,  (5.17) 
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we  conclude  that 


£(A;L)  =  min  ^  eTP-1e  >  £(A;L),  VL  e  t  .  (5.18) 

Thus,  the  Kalman  filter  is  optimal  in  the  sense  of  optimization  of  the  estimation 
error  residence  time  in  every  bounded  domain  of  ft". 

The  optimal  control  law  for  system  (l.l)  with  control  (1.4)  cam  be  obtained 
from  (5.9)  -  (5.10)  by  selecting  F  =  al  and  letting  a  — ►  0.  Indeed,  since  the 
optimal  estimator  law  for  (1.1),  (1.5)  is  the  Kalman  filter,  we  know  from  optimal 
filtering  theory  that  the  optimal  (singular)  filter  for  (1.1),  (1.4)  is  obtained  in  the 
limit  a  — >  0  (see,  e.g.,  [4]).  Therefore,  the  maximal  logarithmic  residence  time 
for  (1.1),  (1.4)  is  given  by 

A*  =  Hmlimlim  ,  L?a)  »  (519) 

t— *00  q[— at—*u 

where  L'J'a  and  K?'a  are  given  by  (5.9)  -  (5.13)  with  FF T  =  a2I. 

6.  EXAMPLE 

Consider  the  second  order  system 


0  1 

0 

1 

X  = 

x  + 

u  +  e 

-1  0 

1 

0 

k  J  L  J  V  J 

y  =  (0  l]x  ,  (6.1) 

z  =  (1  0|x  +  «  Friii  . 
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For  this  system 


-1 


G'«  “  7TT  ■  G"«  “  ?TT  •  °-«  =  ?TT 


(6.2) 


Thus,  since  G,(a)  =  G„i(a)  is  minimum  phase,  this  system  is  art-controllable  by 
controller  (1.4)  when  F  =  0. 

Assume  that  F^O.  Then,  by  Theorem  4.1,  the  logarithmic  residence  time 
in  the  interval  ’F  =  (—a,  6),  a,  b  >  0,  is  bounded  by 


.  1  T/  ^  „  _r.  ,  (min(a,6))2 

min  -  yT(DPDT)  1  y  =  - - . 

i/ea*  2  v  '  2\F\ 


(6.3) 


Furthermore,  when  a  =  6,  the  (sub)optimal  controller  can  be  calculated  using 
(5.9)  -  (5.13)  to  be 


L  = 


I?T 


.  *7  =  -[o  k2\ 


(6.4) 


i-i 


where  K2  >  0  satisfies  the  equation 

JSi.  =  (i  +  M) 

\  2K,j 

The  logarithmic  residence  time  with  this  control  is 

2  K, 


(6.5) 


A  W.i)  = 


2|F|  2Kj  +  |F|  ' 


(6.6) 


A 

Note  that  ji(K?,L)  is  the  upper  bound  in  (6.3)  multiplied  by  the  factor 


P  = 


2K2 


2  K2  +  |F| 
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(6.7) 


Thus,  in  order  to  obtain  logarithmic  residence  time  as  close  as  desired  to  the 
maximal  value,  (6.3),  (6.7)  can  be  used  to  calculate  the  necessary  K%  (for  a  given 
p )  and  /  and  -7  can  be  determined  from  (6.5). 


As  7  — ►  0  equation  (6.5)  simplifies  considerably.  Indeed,  in  this  case  K j  — ►  00 
and,  thus,  for  small  7  (6.5)  becomes 


(6.8) 


Therefore, 

=  •  (6'9) 

7.  CONCLUSIONS 


It  is  shown  in  this  paper  that  the  observer  based  output  feedback  can  be 
efficiently  used  for  pointing  of  linear  systems  subject  to  both  input  and  mea¬ 
surement  noise.  The  fundamental  bounds  on  the  achievable  precision  of  pointing 
depend  on  the  locations  of  the  right  half  plane  zeros  of  the  various  transfer  func¬ 
tions  involved.  Roughly  speaking,  the  best  precision  of  pointing  is  obtained  for 
minimum  phase  systems.  Any  desired  precision  of  aiming  is  attainable  only  if 
no  measurement  noise  is  present.  Therefore,  the  effect  of  the  measurement  noise 
on  the  achievable  precision  of  aiming  is  more  detrimental  than  that  of  the  input 
noise. 
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APPENDIX 


Proof  of  Theorem  3.1:  The  proof  of  (i)  parallels  the  proof  of  Theorem 
3.1  in  [3].  We  omit  the  details  here.  In  order  to  prove  (ii)  we  first  derive  the 
inequality 


2  Tr  DX{K,L)DT 


<  A (K,L)  < 


pR> 


2  Tr  DX{K,  L)DT 


(A.l) 


where  K  €  K,  L  €  C.  To  get  the  left  inequality  note  that 


A (K,L)  >  l  \min[(DX(K,L)DT)-l\mmyTy 

l  y€0w 


2\m[DX(K,L)DT\ 

r* 

2  Tr  DX(K,  L)DT 


For  the  right  inequality  we  have  (R1  =  maxyry,  B(0,  R)  =  {y|yry  <  R2}) 

»€$• 

H(K,L)  =  mm\vT(DX{K,L)DTYly 

s  ^,)1vT{DX{K’L)DTr'y 

=  i  ^\(DX(K,L)Dt)-'\R’ 

R ' 

2\m„\DX{K,l)D*] 

<  _ e*l _  . 

-  2  Tr  DX(K,  L)DT 
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It  follows  from  (A.l)  that  /i*  =  oo  is  equivalent  to 


inf  Tr  DX(K,L)Dt  =  0  . 

K  €  JC 
L€C 


(A.2) 


Next  note  that  it  follows  from  linear  quadratic  theory  [4],  [5]  that 


inf  Tr  DX(K,L)Dt  =  lim  Tr  DX{K\L'1)D'1 


K€K 

Lee, 


(A.3) 


or— *0 


where 

K1 

La 


-  -  BtQ \  AtQ 1  +  QnA  +  DtD  -  -  Q'1BBTQ’1  =  0  ,  (A.4) 

1  7 

-  -  PaET ,  APa  -I-  PaA  +  CCT  -  -  PaETEPa  =  0  .  (A.5) 

a  a 


Furthermore, 


lim  Tr  DX(K',L')DT 

a-*0 


lim  Tr  (DPaDT  +  <xLaT  Q '<La) 

a-»0 

lim  Tr  (CrQ'TC  + ^  K^P^K^) 

a— *0 


(A.6) 


Therefore,  with  C  —  lim  \fa  La  and  D  =  lim  y/i  K1,  we  have 


mf 

kck 

Lee 


Tr  DX(K,  L)D7 


Tr  ( DP°Dt  +  CtQ°C) 

Tr  (£)P°Dt  +  CrQ°C)  . 


(A.7) 


Each  of  the  terms  Tr  DP°DT,  Tr  CTQ°C ,  Tr  DP°DT  and  Tr  CTQ°C  is  nonneg¬ 
ative.  Thus  system  (1.1)  with  control  (1.4)  is  strongly  residence  time  controllable 
if  and  only  if  all  four  terms  are  zero. 
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It  was  shown  in  [3]  that  Tr  CTQ°C  =  0  if  and  only  if  there  exists  a  rational 
matrix  U(a),  with  no  poles  in  Re  a  >  0,  such  that 

+  G,(s)U(a)  =  0  .  (A.8) 

Similarly,  Tr  CTQ°C  =  0,  Tr  DP°DT  =  0  and  Tr  DP°D?  =  0  if  and  only  if 
there  exist  rational  matrices  U(s),  V(s)  and  P(s),  with  no  poles  in  Re  a  >  0, 
such  that 

Gn(s)  +  G,(«)0(s)  =  0  ,  (A.9) 

G„(s)  +  Vr(s)G„i(s)  =  0  ,  (A. 10) 

Gn(s)  +  K(s)Gnl(s)  =  0  (A. 11) 

where 

Gn(a)  =  D(sI-A)~lC  ,  (A. 12) 

G„(s)  =  D{sI-A)~lC  .  (A.13) 

Now,  if  HI  is  satisfied  then  U(a)  =  -G7I(s)Gn(«)  and  U(a)  =  -G7,(s)Gn(a) 
(G~*(a)  is  the  right  inverse  of  G,(a))  are  both  without  poles  in  Re  s  >  0  and 
satisfy  (A.8)  and  (A.9).  Therefore,  Tr  CTQ°C  =  Tr  CTQ°C  =  0.  Furthermore,  in 
this  case  DT D  =  D7 D  (see,  e.g.,  [4])  and,  thus,  H4  implies  that  0  =  Tr  DP°DT  = 
Tr  P°DtD  =  Tr  =  Tr  DP°fir.  Therefore,  by  (A.7)  the  system  is 
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strongly  residence  time  controllable.  Similarity,  if  H3  is  satisfied,  then  V (a)  = 
-G„(a)G~i  (s)  and  V (s)  =  -G„(s)G^/(s)  are  both  without  poles  in  Re  a  >  0  and, 
thus,  Tr  DP°DT  =  Tr  DP °ST  =  0.  Furthermore,  CCT  =  CCT  and,  therefore, 
H3  implies  that  0  =  Tr  CTQ°C  =  Tr  CTQ°C.  This  proves  the  sufficiency  part 
of  the  theorem. 

Assume  now  that  (1.1),  (1.4)  is  strongly  residence  time  controllable.  Then 
(A. 8)  -  (A. 11)  are  satisfied  and,  thus,  H3  and  H4  are  true.  Note  that  the  existence 
of  17(a)  such  that  (A.8)  is  satisfied  and  A4  imply  that  m  >  min(p,r).  Similarly, 
the  existence  of  V(a)  and  A4  imply  that  q  >  min(p,  r).  Assume  p  <  r.  Then 
m  >  p  and,  thus,  G,(a)  is  right  invertible.  Similarly,  if  p  >  r,  then  q  >  r 
and  Gnl(a)  is  left  invertible.  Next,  it  can  be  shown  that  (A.10)  implies  that 
Gn(a)G£(-a)  =  G„(a)Gj(-a).  Furthermore,  Gn(s)  has  no  zeroes  in  Re  a  >  0 
(see,  e.g.  (6j).  Similarly,  (A.8)  implies  that  Gj(-a)G„(a)  =  G^(-a)G„(a)  and 
G„(a)  has  no  zeroes  in  Re  a  >  0.  Thus,  if  p  <  r,  i.e.  G#(a)  is  right  invertible, 

then  it  follows  from  (A. 10)  and  (A.9)  that  G,(a)  has  no  zeroes  in  Re  a  >  0.  Thus 

HI  is  satisfied.  Similarity,  if  p  >  r,  then  (A.8)  and  (A.ll)  imply  that  Gnl(a)  is 
left  invertible  and  minimum  phase,  i.e.,  H2  is  true.  Q.E.D. 

Proof  of  Theorem  3.2:  Let  p{K)  be  the  logarithmic  residence  time  of 

(3.12).  Then,  obviously,  for  any  K  €  K  and  Let  we  have 

A  (K,L)<n(K)  (A. 14) 
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and,  thus, 


aup(i(K,L)  <  n(K)  .  (A.15) 

Lee 

Furthermore,  using  a  similar  argument  to  the  one  in  the  proof  of  Theorem  4.1 
(see  below)  we  have 

sup  fi(K,  L)  =  lim  £( K,  L°)  ( A.16) 

Lee  a~'° 

La  =  PaET  ,  APa  +  P*At  +  CCT  -  -  PaETEPa  =  0  .  (A.17) 

a 

Thus,  we  want  to  show  that  left  invertibility  and  minimum  phase  of  Gnl(a)  is 
necessary  and  sufficient  for 

lim  »{K, L")  =  min  yT{D(X(K)  +  P°)DT)  'v 

=  AK)  (A.I8) 

where 

(A  +  BK)X{K)  +  X{K)iA  +  BK)  +  CCT  =  0  (A.19) 

for  all  K  €  K.  However,  since 

M(/f)  =  min  \  yT(DX(K)DT)~xy  ,  (A.20) 

m 

{A  +  BK)X{K)  +  X{K)(A  +  BK)T +  CCT  =  0  ,  (A.21) 

it  follows  that  (A.  18)  is  true  if  and  only  if  DP°DT  =  0  and  CCT  =  CCT .  These 
are  exactly  the  necessary  and  sufficient  conditions  for  G„i(a)  to  be  left  invertible 
and  minimum  phase.  Q.E.D. 
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Proof  of  Theorem  4.1:  It  is  straight  forward  to  show  that  X(K,L)  >  P 
(see,  e.g.  equation  (A. 25)  below).  Therefore,  since 

/>(*,£)  =  min  i  yT(DX(K,L)DT)~'y  ,  (A.22) 

it 

inequality  (4.2)  follows.  Q.E.D. 

Proof  of  Theorem  4.2:  The  logarithmic  residence  time  in  a  system  with 
the  optimal  estimator  gain  L  =  PET{FFT)~1  is 

A(jr, l)  =  min  \  UT(D(X(K)  +  P)DTy'y  (A.23) 

I f€af  i 


where 

(A  +  BK)X(K)  +  J?(K)  +  LLt  =  0  .  (A.24) 

Thus,  the  upper  bound  (4.2)  is  attained  if  and  only  if  inf  Tr  DX(K)DT  =  0. 
However,  by  the  same  argument  as  was  used  in  the  proof  of  Theorem  3.1,  this 
happens  if  and  only  if  (4.3)  is  satisfied.  Q.E.D. 

Proof  of  Theorem  5.1:  Let  L  be  the  Kalman  filter  gain  (5.9)  and  define 
dx  =  {Ax  +  BKi)dt  +  L(dz  -  Exdt)  (A.25) 

where  i  is  the  estimate  (1.5)  for  an  arbitrary  L.  Then  [5j 

X{K ,  L)  =  £(  L)  +  P  (A.26) 
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where  P  satisfies  (4.1)  and  X  is  given  by 


A  BK  Z  Z  %  Z  A  BK 

+ 

LE  A  +  BK-LE  ZT  X  ZT  LE  A  +  BK-LE 


iFFTLT  Iff7!/ 

+  =0  . 

lfftlt  lfftlt 


(A. 27) 


Define 


X  Xi 
XJ  X, 


X  Z  I  I 


I  0 


i  -i  zT  x  no  -i 


(A.28) 


Then 


A  +  BK  -BK  l  X  X ,  X  Xt  A  +  BK  - BK 

+ 

0  A  -  LE  Xx  Xt  Xf  X2  0  A- LE 


lfftlt  Zfft{l  -  L)T 
+  =0  . 

(L  -  L)FFtL  (t  -  L)FFT(L  -  L)t 


(A.29) 


In  order  to  show  that  K?,  L  satisfy  the  necessary  conditions  for  minimizing 


J!,{K,  L)  we  have  to  show  that  (' = m 

9J‘(F) 


(A. 30) 


gives  F  =  F?  -  (A.30)  is  equivalent  to  showing  that 

|4(f  +  eAF)  =  (Q  (F),  AF'j  =  Tr  AFr|£(F)  =  0  (A.31) 
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for  all  A F  —  ( tfr)  •  In  order  to  simplify  notation  we  assume  WD  —  I.  Evaluat- 
de  «=o 

~  J'JF  +  cAF)  =  l  Tr  X‘~lX  +  7  Tr  KXKt 

“€  (30 

+  7  Tr  A KXKt  +  7  Tr  KXAKT  .  (A.32) 


where 


X  =  —  X{K  +  cA K,  L  +  cA L) 

<=o 

(A.33) 

J?  =  4-  X{K  +  cAK,L  +  cAL) 

de  «=o 

(A.34) 

From  (A.26)  and  (A.28)  we  get  X  =  X  -  Xf  -  X\  +  X*  and 

X*  =  A?  -  X?  -  Xx  +  X\  , 

(A.35) 

X  =  I?  (since  P  =  const.) 

(A. 36) 

where 

*  =  s  *L  • 

(A.37) 

*•  =  ix'„,  ’ 

(A.38) 

K  -  4x,  . 

®c  <=0 

(A.39) 

Using  this  in  (A.32)  gives 

^•Jl(F  +  <AF)  =  ITrX‘-,X' 

*  ..0 
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+  7  Tr  KtK (2*  -  Xf  -  Xj  +  X*,)  (A.40) 

4-  Tf  Tr  XKtAK  4-  7  Tr  AKTK)£  . 

From  (A. 29)  we  get  the  following  equations  for  X,  X\  and  Xj 

( A  +  BK)Z+  >l{A  4-  £X)r  -  BKX\  -  Xf  XrBr  4-  LFFTLT  =  0  ,  (A.41) 
(A  +  -  LE)T  -  +  ^FFt(I  -  I)T  =  0  ,  (A.42) 

(A  -  LF)X,  4-  Xa(A  -  LE)t  +  {L-  L)FFt{L  -  L)r  =  0  .  (A.43) 

Thus,  X',  X|  and  XJ  satisfy 

(A  +  +  X>( A  4-  BJf)r  4-  BAJfX  4-  XAKtBt 

-  BXXi  -  Xf  XrBr  -  BAXXi  -  X?AXrBr  =  0  ,  (A.44) 


(A  4-  BX)X;  4-  Xj(A  -  LB)r  4-  BAXX,  -  XlETALT 

-  BKX\  -  BAJCXj  -  ZFFt&Lt  =  0  ,  (A.45) 

(A  -  LBJXJ  4-  XJ(A  -  LF)r  -  ALBX,  -  X,£r ALr 

-  (L  -  L)tFFt &Lt  -  &LFFt(L  -  L)t  =  0  .  (A. 46) 


Next  we  rewrite  (A.40)  using  (A.35)  and  the  adjoint  equation  for  (A.44).  This 


gives 


^(F  +  eAF) 


=  Tr  (%QB  +  iXKt  -  X\QB)kK 


«*o 
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+Tr  A Kt{BtQX  +  'iKX  -  BTQXj)  -  Tt{QB  +  - iKT)KXl 

* 

-  Tr  X?Kt{BtQ  +  iK)  +  i  Tr  KTKXt  (A.47) 


where 

(A  +  BK)TQ  +  Q{A  +  BK)+lXl~1  +  '1KTK  =  0  .  (A.48) 

Now,  it  follows  from  (A.46)  and  the  last  term  in  (A.47)  that  in  order  for  (A.47)  to 
be  zero  for  any  A L  it  is  necessary  that  X,  =  0.  Thus,  EX t  +  FFT(L  -  L)T  =  0. 
Substituting  L  —  L  =  — Xj ET(FFT)~1  into  (A.43)  gives  Xj  =  0.  Therefore 
L  —  L.  Furthermore,  with  L  =  L  and  Xj  =  0  it  follows  from  (A.42)  that  for 
any  K  €  K  we  have  Xj  =  0.  Therefore  X  =  X  and  the  first  two  terms  on  the 
right  hand  side  of  (A.47)  give  7K  +  BTQ  -  0.  However,  this  makes  the  third 
and  fourth  terms  in  the  right  hand  side  of  (A.47)  also  equal  to  zero.  Therefore, 
in  order  for  (A.47)  to  be  identically  zero  for  any  A F  we  must  have  L  =  L  and 
K  =  -LBtQ. 

Finally,  substituting  K  =  K?  =  -*BTQ  into  (A.48)  gives  (5.11)  and  (A.26), 
(A.41)  with  Jt  =  %  gives  (5.13).  Q.E.D. 

Proof  of  Lemma  5.S:  Note  that  if  Af^  >  0  then  AfJ*  =  N?TN?  for  some  non¬ 
singular  N?.  Furthermore,  since  [D,  A)  is  detectable  it  follows  that  (N?WD,A) 
is  detectable.  Thus,  Q]  >  0  and  €  K.  Q.E.D. 
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Abstract 

In  this  paper,  the  problem  of  aiming  control  is  formulated  and  analyzed  in  terms  of 
the  residence  probability  measure.  Specifically,  the  notion  of  residence  probability  in  a 
domain  is  introduced  and  its  asymptotic  expression  is  derived  for  linear  systems  with 
small,  additive  white  noise.  The  associated  notion  of  (D, Testability,  which  character¬ 
izes  the  performance  of  stochastic  systems  with  no  equilibrium  points,  is  introduced  and 
investigated.  Finally,  the  controllability  of  residence  probability  is  studied  and  the  nec¬ 
essary  and  sufficient  conditions  for  (D,T)-stabiliiability  are  derived.  The  development 
is  based  on  the  asymptotic  large  deviations  theory. 
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1.  INTRODUCTION  AND  STATEMENT  OF 
THE  PROBLEM 

Consider  a  system  described  by  the  Ito  stochastic  differentia]  equation: 

dx  =  (Ax  +  Bu)dt  +  e  Cdw  ,  x(0)  =  x0  ,  (1.1) 

where  x  €  Rn,u  €  Rm, 0  <  e  <  1  and  tv  is  a  standard  r-dimensional  Brownian 
motion.  Let  D  C  Rn  be  an  open  bounded  domain  with  0  in  its  interior  and 
T  <  oo  a  positive  number.  Consider  the  following  problem: 

Given  system  (1.1)  and  the  pair  ( D,T ),  find  a  feedback  law 


a  =  Kx  (1.2) 

and  an  open  set  D0  C  D  such  that  the  closed  loop  system  (1.1),  (1.2)  has  the 
following  property: 


x(t,x0)  €  D,  V  t  €  [0,r),  V  x0  €  \D0\  , 
where  (D0j  is  the  closure  of  D0. 

This  problem  is  referred  to  as  the  problem  of  aiming  control.  Such  a  problem 
arises  in  a  number  of  applications  where  the  goal  is  to  accomplish  a  certain  task 
during  a  specified  period  (T)  with  a  specified  accuracy  ( D ).  Examples  include 
the  telescope  pointing  problem  (lj,  robot  arm  and  laser  beam  pointing  [2j,  [3|, 
missile  terminal  guidance  (4j,  etc. 
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It  is  well  known,  however,  that 


Prob{x(t,x0)  €  dD  for  some  t  >  0|x0  €  [A)]}  =  1  , 

where  dD  is  the  boundary  of  D  and  Do  is  any  open  subset  of  £>,  [5]-[7].  There¬ 
fore,  the  aiming  process  specifications,  (D,T),  cannot  be  met  exactly  and  some 
probabilistic  meaning  should  be  attached  to  their  interpretation.  This  can  be 
accomplished  using  the  notion  of  the  first  passage  time : 

rXo  =  inf{t  >  0  :  x(t)  €  dD\x0  £  [Do)}  .  (1.3) 

Specifically,  the  problem  of  aiming  control  can  be  re-formulated  in  the  following 
two  probabilistic  settings: 

Residence  time  control :  Given  (1.1)  and  a  pair  (D,T),  find  a  feedback  law 
(1.2)  and  an  open  set  D0  C  D  such  that 

E[tXo\>T,  Vx0G[Ao]  .  (1.4) 

Residence  probability  control:  Given  (1.1),  a  pair  (D,T)  and  a  constant  0  < 
p  <  1,  find  a  feedback  law  (1.2)  and  an  open  set  Do  C  D  such  that 

Prob (r,0  >  T)  >  p  ,  V  x0  6  [£>0|  •  (1.5) 

The  residence  time  control  problem  (1.4)  and  its  generalizations  has  been  ana¬ 
lyzed  in  [8|-(12].  In  these  publications,  the  fundamental  bounds  on  the  achievable 
values  of  £[r«„)  have  been  investigated  and  the  methods  for  controllers  design, 
compatible  with  these  bounds,  have  been  developed. 
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The  residence  probability  control  (1.5)  appears  to  be  a  stronger  reformulation 
of  the  aiming  control  problem  than  the  residence  time  control.  Indeed,  since  r,0 
is  non-negative  random  variable,  the  Markov  inequality  gives: 

Prob{r,0  >  T)  <  . 

Therefore,  if  Prob{r*0  >T}>p,  the  estimate  for  E[rt0\  follows  immediately: 

On  the  other  hand,  it  is  possible  to  show  (see  Appendix  4)  that  for  any  D,Do,T 
and  0  <  p  <  1  there  exists  a  feedback  law  (1.2)  and  Xo  €  Do  such  that  the  closed 
loop  system  (1.1),  (1.2)  has  the  following  property: 

E[rt0  J  >  T  , 

Prob{r«0  >T)  <p  . 

This  implies  that  the  closed  loop  system  may  exhibit  a  performance  as  good  as 
desired  from  the  residence  time  point  of  view  and  as  bad  as  desired  from  the 
point  of  view  of  the  residence  probability. 

These  observations  justify  the  problem  of  residence  probability  control  and, 
in  addition,  indicate  that  it  has  a  more  complicated  mathematical  structure  than 
residence  time  control  problem. 

This  paper  is  devoted  to  the  investigation  of  the  controllability  properties 
of  residence  probability,  i.e.,  to  the  question  on  when  there  exists  a  feedback 
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taw  u  =  Kx  that  solves  the  residence  probability  control  problem.  The  related 
question  of  design  of  the  residence  probability  controllers  will  be  addressed  in  a 
companion  paper.  As  it  was  the  case  of  [8]-[12],  the  development  is  based  on  the 
large  deviations  theory  of  (7j. 

The  idea  of  utilizing  the  residence  probability  as  a  measure  of  control  systems 
performance  is  not  new.  Apparently,  it  was  first  introduced  in  [13]  and  then 
analyzed  in  [14]-[17].  The  approach  of  [14]  is  based  on  the  stochastic  Liapunov 
functions  and  as  a  result  the  estimates  obtained  are  quite  conservative.  Indeed, 
if  (A  +  BK )  and  C  of  (1.1),  (1.2)  have  the  form  of  Example  4,  Chapter  3  of  [14], 
i.e., 


A  +  BK  = 

0  1 

,  C  = 

0 

-1  -1 

1 

and  D  is  given  by 

3 

D  =  {x  €  R3  :  -  zj  +  ZjZj  +  x\  <  2}  , 

then  choosing,  for  instance,  Zo  =  [1  0]T,  the  approach  of  [14]  results  in 

Prob{r,0  <  T}  <  1  -  0.25*-^  .  (1.6) 

Using  the  asymptotic  method  of  this  paper,  for  the  same  example  we  obtain 

Prob{r,0  <T}<  ,  0  <  T  <  oo  .  (1.7) 

Obviously,  (1.6)  and  (1.7)  have  different  asymptotic  behavior:  when  «  is  very 
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small,  (1.7)  gives 


Prob{r*0  <  T}  =s  0  , 


whereas  (1.6)  results  in 

Prob{rl0  <  T}  <  0.75  . 

Thus,  the  asymptotic  approach,  although  restricted  by  the  condition  e  <  1,  is 
advantageous  in  comparison  with  the  Liapunov  functions  method. 

Note  that  along  with  (6]  and  [7],  there  are  other  asymptotic  techniques  for 
calculating  the  residence  probability  (see,  for  instance,  [l8]-[20]).  However,  the 
problem  of  controllability  of  residence  probability  has  not  been  explored.  It  is 
done  in  this  paper. 

The  structure  of  the  paper  is  as  follows:  In  Section  2  an  asymptotic  formula 
for  residence  probability  in  a  domain  is  derived.  In  Section  3,  the  notion  of 
(D,  Testability,  that  characterizes  the  behavior  of  stochastic  systems  with  no 
equilibrium  points,  is  introduced  and  analyzed.  Section  4  presentes  the  conditions 
for  residence  probability  controllability  and  ( D ,  T)-stabilizability.  In  Section  5, 
the  conclusions  are  formulated.  The  proofs  are  given  in  Appendicies  1-4. 

2.  RESIDENCE  PROBABILITY  IN  A  DOMAIN 

Consider  the  Ito  system 

dx  =  Axdt  +  «  Cdw  ,  i(0)  =  x0  ,  (2.1) 
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where,  a s  before,  x  €  R I",  0  <  e  C  1  and  w  is  a  standard  r-dimensional  Brownian 
motion.  Let  D  C  Rn  and  Do  C  D  be  open  bounded  seta  with  0  in  their  interior 
and  smooth  boundaries  dD  and  dD0,  respectively.  The  first  passage  time  of  the 
trajectory  originating  at  xq  is 

rt0  =  inf{t  >  0  :  x(t)  6  dD\x 0  €  (£>o)}  •  (2.2) 


As  a  random  variable,  rl0  is  characterized  by  its  probability  distribution,  i.e., 
Prob{rIO  <  T}.  Based  on  this  distribution,  the  first  passage  probability  of  the 
trajectories  originating  in  [£?o]  can  be  defined  as  follows: 

PdAt  <T}  =  I^0,Prob^«o  <  T)  •  (2.3) 

Then  the  residence  probability  in  the  domain  is 

Pd.{t>T)  4  1  -  PD,{,  <  T)  (2.4) 

=  ”,iS1Prob(r..  >  T>  ■ 

«o€(X>0| 

These  probabilities  play  a  crucial  role  in  the  development  that  follows.  They  are 
characterized  next: 

Theorem  2.1:  Assume  that  (A,C)  is  disturbable.  Then 
lime* lnPD„{r  <  T)  =  -  min  min  ^(y  -  eA‘x0)rX_1(t)(y  -  eA*z0)  ,  (2.5) 

<—0  «u€(Du I  2 

o<»<r 

where 

AT(t)  =  AX(t)  +  X(t)Ar  +  CCT  ,  X(0)  =  0  .  (2.6) 
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Proof:  See  Appendix  1. 


The  interpretation  of  this  result  is  as  follows:  Let  —  <p{Do)  denote  the  right 
hand  side  of  (2.5),  i.e., 

ip(Do)  =  min  min  ^(y  -  eAtx0)T X~l{t)(y  -  eAtx0)  .  (2.7) 

z,,€{D0\  V&9D  2 
Q<t<T 

<1 

Then,  according  to  Theorem  2.1,  if  e  is  sufficiently  small,  for  any  6  >  0, 

.-"V**  <  Po.{r  <  T)  <  .-"V*  , 

i.e.  Pd„{t  <T}\a  logarithmically  equivalent  to  e~  .  Due  to  this  reason,  <p{D0) 
is  referred  to  as  the  logarithmic  first  passage  probability.  Obviously,  the  residence 
probability  in  the  domain,  i.e.,  PDo{r  >  T},  is  logarithmically  equivalent  to 

As  it  follows  from  the  above,  the  logarithmic  first  passage  probability  is  in¬ 
dependent  of  the  distribution  of  initial  points  xo  in  Do-  In  addition,  <p(Do)  is 
a  coordinate-free  characterization  of  system’s  performance.  Indeed,  consider  a 
similarity  transformation 

x  =  Qx,  det  Q  ^  0  (2.7) 


and  the  system 


dx  =  Axdt  +  e  Cdw  , 

A  =  Q~lAQ  ,  C  =  Q~lC  (2.8) 
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Let 


D  =  {xeRn  :  Qx€D)  , 

D0  =  {f  €  Rn  :  Qx0  €  D0}  . 

and  <p(Do)  be  the  logarithmic  first  passage  probability  from  D,  i.e., 
ip(Do)  =  min  min  ^(y  -  eit‘x0)rX'1(t)(y  -  e^'io)  . 

i€|0o]  t€9D  2 

o<«<r 

Then 

Lemma  2.1:  &(D0)  =  <p{D0). 

Proof:  See  Appendix  1. 

This  property  will  be  used  in  Section  4  to  establish  the  upper  bound  of  the 
achievable  logarithmic  first  passage  probability  for  system  (1.1). 

3.  (D, TESTABILITY 

If  a  stochastic  system  has  an  equilibrium  point,  its  stability  can  be  char¬ 
acterized  by  the  usual  notion  of  Liapunov  stability  modified  in  an  appropriate 
stochastic  sense  [14],  [21].  If  the  system  does  not  have  equilibria,  as  is  the  case 
for  (2.1),  the  Liapunov  stability  does  not  apply.  In  this  situation,  the  notion  of 
first  passage  time  could  be  used  to  describe  its  “stability”  features.  One  way  to 
accomplish  this  is  as  follows: 
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Definition  3.1:  System  (2.1)  is  said  to  be  (D,  Testable  with  probability 
0  <  p  <  1  if  there  exists  an  open  set  D0  C  D  such  that 

Pd0{t  >T}>p  (3.1) 

or,  equivalently, 

Pd„{t  <  T}  <  1  -p  ,  (3.2) 

where  Pp0{r  >  T}  and  Pd0{t  <  T}  are  defined  in  (2.4)  and  (2.3),  respectively. 

In  this  Definition,  set  D  may  be  interpreted  as  a  safe  operating  region,  T  as 
a  desired  operating  time,  and  Do  as  an  initial,  “lock  in”,  set. 

Applying  this  definition  to  system  (2.1)  and  taking  into  account  Theorem  2.1, 
we  see  that  (2.1)  is  (D,  Testable  with  probability  p  if  there  exists  D0  C  D  such 
that 

»(Onl 

1  —  e  «J  >  p  , 

where  <p(D0)  is  the  logarithmic  first  passage  probability.  Thus,  the  analysis  of 
(D,  Testability  is  equivalent  to  the  calculation  of  <p(Do)  for  a  given  D. 

The  calculation  of  <p(Dq)  according  to  (2.7)  may,  however,  be  difficult.  There¬ 
fore,  simpler  sufficient  tests  for  (D,  Testability  and  instability  are  given  below: 

Theorem  3.1:  Assume  that  A  is  Hurwitz,  (A,C)  is  disturbable  and  there 
exist  a  matrix  Af  >  0  and  a  number  Rq  >  0  such  that 

AtM  +  MA<0 
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T1  A 

i  =  min 


>0  , 


«'eaD""  VWM) 
where  Xmin(M)  is  the  smallest  eigenvalue  of  Af  and  ||  •  ||  is  the  Eucledean  norm 
of  a  vector.  Then  (2.1)  is  ( D ,  r)-stable  with  probability  1  -  e-®/**  where 

r* 


a  < 


2Am„(X(r))  ’ 


X(t)  is  the  covariance  matrix  defined  by  (2.6)  and  AmfcX(A'(r))  is  the  largest 
eigenvalue  of  X(T).  The  corresponding  initial  set  Do  in  this  case  is: 


Dq  —  {x  €  Rn  •  xtMx  <  /^}  . 


Proof:  See  Appendix  2. 

Theorem  3.2:  Under  the  assumption  of  (A,  C)  disturbability,  system  (2.1) 
is  not  ( D ,  Tj-stable  with  probability  p  =  1  —  e~a '!*  if 

max  ||y  ||* 
re  9D _  < 

2Am„(X(T)) 


Proof:  See  Appendix  2. 

Thus  Theorems  3.1  and  3.2  provide  the  lower  and  upper  bound  for  the  resi 
dence  probability  in  the  domain: 


1-exp 


rain  llyll  - 


fr) 


2AmM(A-(r))<’ 


<  PDo{t  >  T)  <  1-exp 


max 

y€9D 


2Am„(X(T))eJ 


(3.3) 
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To  illustrate  the  application  of  these  bounds  and  the  utility  of  (D,  Testability, 
consider  an  example  where  two  systems  have  identical  LQG  performance  mea¬ 
sures  but  different  (D,  Testability  properties.  Specifically,  consider  system  (1.1) 
with 


A=  ,  B  =  ,  C  =  (3.4) 

2  -i  1  1 

and  the  initial  point  x0  distributed  uniformly  in 

D0  =  (x0  '•  a£xo  <  r1}  • 

Assume  that  the  goal  of  control  u  is  to  keep  x(t)  within 

D={x:  lTx<R'),R>r 

during  the  time  period  T.  To  find  controls  that  achieve  this  goal  with  some 
accuracy,  introduce  two  performance  indecies 

Jx  -  “j"  // \j-M  +  *’,)  +  «’]  <* 

and 

Ji  =  nin^fo  +I»)  +  0  0574  u*  dt 

Minimizing  the  expected  values  of  these  criteria,  in  the  limit  as  T  — *■  oo,  for 
R7  =  2  we  obtain 

EM  =  Etn{J,]  =  0.0576  r*  . 
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These  optimal  values  are  achieved  under  controls  u,  =  K{X,  i  =  1,2,  where 


Ki  =  -  (0.2949 

0.2247]  , 

(3.5) 

Kj  =  -(2.3627 

3.2920]  , 

(3.6) 

respectively.  Thus,  under  gains  (3.5)  and  (3.6)  the  two  closed  loop  systems  have 
equal  LQG  performance  measures.  Next  we  investigate  their  (£>,  Testability 
properties. 

Since  matrices  A  +  BKi,  i  =  1,2,  are  Hurwitz  and  pairs  (A  +  BKi ,  C),  i  = 
1,2,  are  disturbable,  Theorems  3.1  and  3.2  are  applicable.  Since 

( A  +  BKi)T  +  (A  +  BK{)  <  0  ,  i  =  1,2  , 


choose  M  =  I,  min  ||y||  =  R  and  Rc  =  r.  The  calculations  of  bounds  (3.3) 

yeOD 

gives: 


1 


ima— »)’ 

e 


1  -  e  ’ 


<  PdM*i)  >  10)  <  1  - 

<  PD„{r(Kt)  >  10}  <  1  -  e~X3^~ 


1 


When  r  is  sufficiently  small,  the  bounds  defined  by  K\  and  K j  do  not  overlap 
and  Pd„{t(K j)  >  10}  >  P{r(Ki)  >  10}.  Analogous  situation  takes  place  for  T”s 
other  than  10.  Indeed,  for  T  =  1  and  T  =  0.1  we  obtain: 


1  _  <  PD.l r(K,)  >  1}  <  1  -  , 

1  _  <  P0„{r(K,)  >  1}  <  1  -  ; 
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1 


1  -  <  PoMKi)  >  0.1}  <  1  - 

1  -  . <  P0„{r(/f,)  >  0.1}  <  1  -  . 


Hence,  in  spite  of  their  equivalence  in  the  LQG-sense,  the  two  feedback  gains  are 
different  in  terms  of  the  resulting  residence  probabilities  or  (D,  Testability. 

The  LQG  and  the  residence  probability  performance  measures  could  be  in 
direct  contradiction  with  each  other.  Indeed,  continuing  example  (3.4)  with 


=  nJfI0  +  ij) +tt* 


dt 


it  is  possible  to  show  that  J(d)  is  an  increasing  function  of  d  whereas  P0l){r  <  T} 
is  decreasing.  This  is  illustrated  in  the  Table  below: 


fl 

Kd 

E.,Wd)) 

Pd,{t  <  1} 

0.5 

-{0.1641  0.1180) 

0.0309  r* 

1 

1 

SShpUII 

5 

-[1.8397  2.3166] 

0.6419  r2 

i 

1 

hBhEHHh 

4.  RESIDENCE  PROBABILITY  CONTROL¬ 
LABILITY  AND  (D,T)-STABILIZABILITY 


Consider  again  system  (1.1)  with  control  (2.1).  As  it  follows  from  Theorem 
2.1,  if  (A  4-  BK,  C )  is  disturbable, 

lim  t1  In  Pd„{t{K)  <  T}  =  -<p(D0,K)  , 
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where  <fi(Do,  K)  is  the  logarithmic  first  passage  time  defined  by 
<p(D0,K)  =  min  min  i(y  -  e{A+BK)x0)T  X~l{t,K){y  -  e{A+BK)xo)  ,  (4.1) 

to€  Do  v€9D  2 
0<t<T 

X{t,  K)  =  {A  +  BK)X(t ,  K)  +  X{t,  K){A  +  BK)T  +  CCT ,  X(0,  K)  =  0  . 

Note  that  if  (A,[BC\)  is  disturbable,  {A  +  BK,C)  is  disturbable  for  almost  any 
K[ 22).  We  would  like  to  choose  the  feedback  law  (1.2)  so  that  <p(D0,K)  is  as 
large  as  desired,  i.e.,  the  residence  probability,  which  is  logarithmically  equivalent 

yjPn.K) 

to  1  —  e  A  ,  is  as  close  to  1  as  desired.  This  may  or  may  not  be  possible.  To 
characterize  the  various  situations,  introduce 

Definition  4.1:  System  (1.1)  is  said  to  be  strongly  residence  probability  con¬ 
trollable  (srp-controilable)  if  for  any  {D,  T)  and  a  >  0  there  exists  u  =  Kx  and 
D0  C  D  such  that  <p{D0,K)  >  a.  Otherwise  the  system  is  weakly  residence 
probability  controllable. 

The  srp-controllability  is  equivalent  to  the  property  of  (D,  r)-stabilizability: 

Definition  4.2:  System  (1.1)  is  (D,r)-stabilizable  if  for  any  ( D,T )  and 
0  <  p  <  1  there  exists  u  =  Kx  and  Do  C  D  such  that 

PDo{r  >T}>  p  . 

Below,  the  class  of  srp-controllable  systems  is  characterized. 

Theorem  4.1:  Under  the  assumption  of  {A,C)  disturbability,  (1.1)  is  srp- 
controilable  or,  equivalently,  (D,T)-stabiiizable,  if  and  only  if  Im  C  C  Im  B. 
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Proof:  See  Appendix  3. 


If  Im  C  £  Im  B,  there  exists  an  upper  bound  on  the  achievable  <p(Dr,yK). 
This  bound  is  analyzed  next. 

Consider  again  (1.1)  and  assume  that  B  has  a  full  rank.  Then  there  exists  a 
similarity  transformation  x  =  Qx  that  transfers  (1.1)  to  the  form 


dx  =  (Ax  +  Bu)dt  4-  €  Cdw 


(4.2) 


QAQ  =  A  = 


An 

■ 

r 

Au 

,  Q~lB  =  B  = 

I 

,  Q~lC  =  C  = 

Cl 

An 

Ajj 

0 

[  c2 

Since,  according  to  Lemma  2.1,  <p(Do,  K)  =  <p(D0,  K),  the  bounds  will  be  estab¬ 
lished  in  terms  of  the  realization  (4.2). 


Assume  (A,  B)  is  controllable  and  choose 


1  , 


u  =  K,x ,  K ,  =  — BTP,  p  >  0  , 
P 


(4.3) 


where  Pp  is  the  positive  definite  solution  of 


A?  P,  +  PtA  +  f  —  -P,BBTP,  =  0 
P 


Let  Pjj  be  the  positive  definite  solution  of 

AnPn  +  PjjAn  +  /  —  =  0 

and 


(4.4) 


(4.5) 


A  —  -AjiAjjPjj  +  A 


(4.6) 
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Let  a  and  0  be  positive  numbers  that  satisfy  the  inequality: 

(l|P«A„Xj;pII||,  +  l)||/,||i<ae-»'  ,  (4.7) 

where  jj  •  j|3  is  the  induced  /j-norm  of  a  matrix.  Finally  let  M  >  0  and  Rq  >  0 
be  a  matrix  and  a  number,  respectively,  satisfying 

lim[(A  +  BK,)tM  +  M{A  +  BK,)\  <  0  (4.8) 

T  =  min  ||y|| - —  — ■  >  0  .  (4.9) 

•€3D  /uw 

Theorem  4.2:  Under  the  assumption  of  controllability  of  ( A,B )  and  dis- 
turbability  of  ( A,C )  and  for  all  T  >  0  such  that 


1  -  ae~20T  >  0  , 


(4.10) 


the  maximal  achievable  logarithmic  first  passage  time,  ma x<p(D0,  Kf),  is  bounded 
as  follows: 

rJ  max  ||y||* 

W-  <  max0(3o,ft,)  =  ,  (4.11) 


where 


An ,«(C»Cf) 

2(A  max  (AuAjt + 

Tr  CjP„C, 


(4.12) 

(4.13) 


and  T,  M ,  a  and  0  are  defined  by  (4.9),  (4.8)  and  (4.7),  respectively. 


Proof:  See  Appendix  3. 
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Note  that  in  the  srp-controllability  case  C2  =  0,  A*  =  A**  =  0  and,  therefore, 


lim^>(I?oi  Kf)  =  oo  . 


As  it  has  been  pointed  out  in  Section  1,  the  residence  probability  control 
problem  has  a  more  complex  nature  than  residence  time  control.  This  complexity 
manifests  itself  through  the  fact  that,  unlike  the  residence  time  (see  [8),  formula 
(3.6)),  the  bounds  on  the  maximal  achievable  residence  probability  depend  on 
the  desired  period  of  operation  T  and,  more  importantly,  on  the  size  of  the  initial, 
“lock  in”  set  D0. 


To  illustrate  the  bounds  of  Theorem  4.3,  consider  an  example  of  the  roll 
attitude  control  problem  in  a  missile  disturbed  by  a  random  torque  [23].  The 
dynamics  of  the  system  are  described  as 


- 

' 

* 

■ 

* 

• 

6 

0 

0 

0 

6 

1 

0 

U 1 

— 

10 

-1 

0 

Ul 

+ 

0 

u  +  e 

1 

V 

0 

1 

0 

<P 

0 

0 

(4.14) 


where  6  is  the  aileron  deflection,  w  is  the  roll  angular  velocity,  <p  is  the  roll  angle, 
u  is  control  of  aileron  actuators  and  w  is  white  noise.  Note  that  (4.14)  is  in  the 
form  (4.2)  with  Cj  #  0,  i.e.,  the  system  under  consideration  is  wrp-controllable 
and  <p(Do,  K)  is  bounded.  To  evaluate  this  bound,  assume,  for  simplicity,  that 
D  is  a  ball  with  radius  R  and  calculate 


A*  =  0.04975  ,  A”  =  0.1  ,  a  =  12  ,  (3  =  2  . 
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Choosing  M  as 


0.25 

0.25 

0.25 

0.25 

0.35 

0.35 

0.25 

0.35 

1.35 

(4.15) 


and  varifying  that  (4.8)  holds,  we  finally  obtain: 


10.05 /21 


12e~2T 


,  T> 


In  12 
2 


Thus,  there  is  no  linear  controller  (4.3)  for  missile  (4.14)  that  keeps  the  states 
in  the  ball  of  radius  R  during  interval  T  with  probability  p  >  1— exp  {  ~  } 

On  the  other  hand,  there  exists  a  linear  state  feedback  that  accomplishes  this 
task  with  probability  p  <  1  -  exp  (fZ  -  ^43)  }>  provided  that  at  t  =  0  the 
states  are  locked  into  the  initial  set  Do  =  {x  :  xrMx  <  JZo},  where  M  is  given 
by  (4.15). 


5.  CONCLUSIONS 

1.  The  residence  probability  control  gives  a  stronger  reformulation  of  the 
aiming  control  problem  than  the  residence  time  control.  However,  the  resulting 
control  problem  is  also  more  complex:  the  performance  depends  on  the  size  of 
the  initial,  "lock  in”,  domain  and  on  the  operating  period. 

2.  The  (D,  Testability  with  probability  p  is  a  useful  tool  for  characterization 
of  the  performance  of  stochastic  systems  with  no  equilibrium  points.  The  per¬ 
formance  in  terms  of  (D,  Testability  may  be  contradictory  to  the  performance 
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in  terms  of  LQG  criterion. 


3.  The  residence  probability  of  a  controlled  linear  system  with  additive  white 
noise  can  be  modified  in  any  desired  manner,  for  instance,  made  as  close  to  1  as 
desired,  if  raid  only  if  the  range  space  of  the  noise  matrix  is  included  in  the  range 
space  of  the  control  matrix.  Otherwise,  the  achievable  residence  probability  is 
bounded  away  from  1  and  estimates  of  this  bound  are  characterized  herein. 
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APPENDIX  1 


Proof  of  Theorem  3.1: 

Consider 

dx  =  Axdt  4-  £  Cdu /,  i(0)  =  xo  ,  (Al.l) 

where  x  €  Rn,  0  <  e  <  1  and  w  is  a  standard  r-dimensional  Brownian  motion. 
Let  U{t)  be  an  absolutely  continuous  function  in  RT  and  define  Fro  (U)  as  follows: 

Fxo(U)  =  =  x0  +  fT  A<f>dt  +  CU  .  (A1.2) 

Jo 


The  mapping  F,„(£/)  is  continuous  with  respect  to  U  and,  assuming  without  loss 
of  generality  that  C  has  a  full  row  rank,  one-to-one.  Therefore,  as  it  follows  from 
Theorems  3.1  (Chapter  3)  and  1.1  (Chapter  4)  of  (7),  the  action  functional  for 
(Al.l)  is: 


■S’ot(^)  =  Sor(tt)  = 


oo  ,  if  F~0l{<j>)  is  empty 

|  /0T  uTudt,  4  =  A<f>  +  Cm,  ^(0)  =  Xq,  otherwise, 


(A1.3) 


where  u(t)  =  U(t). 


Define 


r9o  =  min{t  :  x{t)  €  dD\x^  €  D)  , 


where  D  C  Rn  is  an  open  bounded  set  in  Rn  with  0  in  its  interior  and  smooth 
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boundary  dD  and  x(t)  is  the  trajectory  of  (Al.l).  Introduce  also 


Hd{T,x o)  =  {0  G  Cvr(Rn)  :  0(0)  =  xo  €  D,  0(a)  &  D  for  some  a  G  [0,r]} 

(A1.4) 

tJD(T,x0)  =  {u  C  Cor{Rn)  :  0  €  77c(7\xo)*  0  =  A0  +  Cu,  0(0)  =  x0}  (A1.5) 
It  follows  from  Theorems  1.1  and  1.2  (Chapter  4)  of  [7]  that  if 

_inf  {-Sor(u)  :  <j>€[Hp(T,x o))}  =  _«nf  (5or(u)  :  0  G /fD(r,Xo)}  , 

ti€^£>(T,*o)  u6^o(r,*o) 

(A1.6) 

then  uniformly  with  respect  to  all  xo  €  Rn, 


lime1  lnProb{r,u  <  T}  =  -  jnin  Sor(u)  .  (A1.7) 

«-°  «6yD(r.*„) 

To  prove  that  (A  1.6)  holds  assume  that  the  minimum  of  Sot(«)  on  set  U d[T,  xo) 
is  attained  at  function  u*.  Denote  the  corresponding  0(t)  as  0*  and  assume  that 
0*  reaches  dD  at  t*,  i.e.,  0*(t*)  6  dD.  Define  the  neighborhood  of  0* (f)  as 
follows: 

iV(«*,(«)  =  {x  G  Rn  :  1 0*(O  -  *|  <  tf,  6  >  0}  . 


For  any  6  >  0,  choose  xf  G  Nf(r)  which  is  not  contained  in  D.  Due  to  the 
assumption  that  (A,C)  is  disturbable  there  exists  us  such  that  0(u*(a))  =  xs  for 
some  a  G  (0,  T\.  Therefore,  0(u*)  is  in  the  interior  of  HD(T,x0).  Since  S0T{u)  is 
differentiable  and 

limSor(u,)  =  50t(u’)  , 

6  •  0 
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this  implies  that  condition  (A1.6)  is  satisfied,  and  (A1.7)  holds. 


To  solve  the  minimisation  problem  of  (A1.7)  we  observe  that,  as  it  follows 


from  [7],  p.  107, 


where 


min  Sot(u)  =  mm  V{t,  x0,y) 
ueUD(T,x0 )  v€dD 

o  <t<T 


V (t, z0, y)  =  min-  f  uTudt 
“  2  Jo 

j>  =  A<j>  4-  Cu,  ^(0)  =  z0,  <t>{t)  =  y 


(A1.8) 


(A1.9) 

(A1.10) 


Problem  (A1.9),  (A1.10)  can  be  solved  using  a  standard  variational  approach. 
The  necessary  conditions  of  optimality, 

**  =  A0-+CU*  ,  0)  =  Xo,  *•(«)  =  y 

P  =  -  Atp' 

u*  =  -CV  , 


result  in 

u*(r)  =  -CTrAT^X~l{t)(y  -  eAtx0) 

and,  hence, 

^(Mo.y)  =  ^(y  -  eA‘xo)TA'*l(0(y  -  «A,*o)  * 

where 


X  =  AX  4-  XAt  +  CCT,  X(0)  =  0  . 
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Thus,  according  to  (Al.8), 


min  Sot(u) 

ueUD(T,z0) 


“in  ^(y~cA<;co)r*X’~1(0(y-«A*:co) 

0  <t<T 


which,  together  with  (A1.7),  defines  the  distribution  of  the  first  passage  time  of 
a  trajectory  originating  at  xq. 


To  complete  the  proof  consider 

PdAt  <  T}  =  max  Prob{rt0  <  T}  , 

*oe(n„) 


where  D0  C.  D  is  an  open  set  containing  0  with  a  smooth  boundary  dD0.  Taking 
into  account  the  continuity  of  In  Prob{rtl(  <  T},  the  uniformity  of  the  limit  in 
(A1.7),  and  the  compactness  of  [Z?0J, 

lime2 lnPo0{»“*o  <  T}  =  lime2 In  max  Prob{r,u  <  T} 

*-*0  «-»0  xu€(0oj 

=  lime2  n.  x  In  Prob{rln  <  T}  =  max  lim  e2  In  Prob{r,  <  T} 

«-o  v  -  1  *o€[n0|  «-»0  1  *"  “  1 

=  mwc  -  Ttin\(y-tMx0)TX-x{t){y-tMx0) 

so€(0'»|  y€dD  2 

o<e<r 

=  "  ini  \{y-'A,Zo)TX-'(t){y-eA,x 0)  . 

So€(Du|  2 

0<t<T 

Q>E>D. 

Proof  of  Lemma  2.1:  Since  X(f)  =  QX(t)<Jr, 

(y  -  ^io)IX-'((Hv  -  e*i„) 

=  («?-*»  -  Q~''*'QQ~'z<1)TQr X-'(t)Q(Q-'y  -  Q-'S'QQ-'z*) 

=  (y  -  e'“x0)rX",(l)(y  -  tM*>)  ■ 
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Therefore, 


0{DO)  =  min  min  \(y  -  eAtx0)TX~l{t)(y  -  e^zo) 

£o€(^u|  QG9t)  2 
0<«<T 

=  ,„1&i  Jlffi  5(» "  'M*>)Tx~lWy  -  «"*•)  =  *><«>>  • 

0  <t<T 

Q<E>D> 
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APPENDIX  2 


Proof  of  Theorem  3.1:  Observe  that 


<p(D0) 


mm  min  y  -  e 

*o€|Oo)  y6 dD 

>  0<<<T _ 

2Am„(X(T)) 


Since  A  is  Hurwitz,  there  exists  M  >  0  which  satisfies 


AtM  +  MA<0  . 


Then  D0  =  {x  e  Rn  :  xTMx  <  is  an  invariant  set  for  (2.1)  with  f  =  0.  If 


T  =  min  HvH  -  - - 


>0  , 


this  invariant  set  is  contained  in  D.  Therefore, 


¥>{Do)  > 


mm  ,  mm  y  -  e^‘zo  1 

««e  x>0  *6 9D 

_ o<«<r _ 

2Am„(A-(t)) 


—  n\  /  xr/j.\\  ‘ 


2Am„(X(t)) 


This  implies  that  (2.1)  is  (/?,  Testable  with  probability  1  -  e~a/*2  where 


0  <  a  <  . 


Q.E.D. 
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Proof  of  Theorem  3.2: 


*(*>  ^  ^yr-X'"1(0y 

o<«r 


1 


S  SS  2V  X~  (‘)V  =  oS&r  2*™(X-'(t))R' 

0<t<T 


R3  A 
2  Am„(X(T))  1 


where  B  —  {x  €  Rn  :  ||x||  <  72}  and  R  =  max  ||y||.  This  implies  that  (2.1)  is  not 
(D,T)- stable  with  probability  1  —  e'*/*3,  where  a  > 


Q.E.D. 


APPENDIX  3 


Proof  of  Theorem  4.1:  Sufficiency:  If  Im  C  C  Im  B,  the  disturbability 
of  ( A,C )  guarantees  the  controllability  of  ( A,B ).  Then,  as  it  was  shown  in  [8], 
there  exist  a  sequence  {Ka}  such  that  (A  +  BKa)  is  Hurwitz  for  Va  6  |l,oo),  a 
set  D0  which  is  invariant  set  for  i  =  (A  +  BKa)x  for  Va  and,  in  addition, 

lim  Xoo{Ka)  =  0  , 

a— *oo 


where 

{A  +  BKJXcoiKJ  +  Xgo{Ka(A  +  BKa)T  +  CCr  =  0  . 


Since  X(T,Ka)  <  X^K*),  VT  >  0 

lim  X(T,Ka)  =  0  ,  VT>  0  , 

ar-*oo 


where 

X{t,Ka)  =  [A  +  BKJX^Ka)  +  X„{Ka){A  +  BKa)T  +  CCT  . 

Therefore,  by  using  Theorem  3.1, 

lim  <p(Do,  Ka)  =  oo  , 

a-*oo 

which  implies  that  (1.1)  is  srp-controllable  . 

Necessity:  Assume  that  (1.1)  is  srp-controllable.  Then  there  exists  a  se¬ 
quence  {Ka}  such  that  lim  <fi{D0,Ka)  =  oo,  which  implies  that  lim  Xm%x(X{T,  Ka)) 

a-*oo  u^oo 
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0  or  lim  TrX[T,Ka)  =  0.  Then  by  Fatau’s  lemma, 

a— *oo  v 

0=  lim  TrX(T,Ka)  =  lim  Tr  /%(A+**-)‘CC,re(x+fl*<*>T‘(ft 

a~*oo  '  a-*oo  7q 

>  [T  lim  infTr{e{A+BKa)tCCTe{A+BKa)Tt)dt  .  (A3.1) 

Jo  a~‘°°  * 

Since  >  0,  V  t  6  [0,T]  and  a,  (A3.1)  gives: 

lim  inf  Tr(e(A+BK°)tCCTeLA+B*°)T‘)  =  0 

a— *oo 

for  almost  all  t  €  (0,  T\.  Therefore,  there  exists  a  subsequence  {Kp}  of  {Ka} 
such  that 

lim  Tr{e{A+BK<>)tCCTe{A+BKt)Tt)  =  0  (A3.2) 

0—*OO 

for  almost  all  t  €  [0 ,T].  Noting  that  X(t,Kp)  obeys  the  equation 

(A  +  BKp)X{t ,  Kg)  +  X{t,  Kg)(A  +  BKpf  +  CCT 

=  t{A+BK,)tCCTt(A+BKt)Tt  (  V  t  ,  (A3.3) 

from  (A3.2)  and  (A3.3)  it  follows  that 

lim  [{A  +  BKfi)X{t ,  tf*)  +  X{t ,  K„)(A  +  fltf, )T  +  CCT{  =  0  ( A3.4) 

0  •  oo 

for  almost  all  t  €  [0,T|.  Since  we  know  that  X{t,Kp)  -*  0  as  0  ■—  cx>,  (A3.4) 
implies  that 

Iim|fl/OX(l,K»  +  X(l,A»tfj5r|  +  CCr  =0  (A3.5) 

0—+OO 
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for  almost  all  t  6  (0,  T].  Therefore,  there  exists  Q(t)  such  that 


BQ{t)  +  QT{t)BT  +  CCT  =  0 


(A3.6) 


which  is  possible  only  if  Im  C  C  Im  B. 


Proof  of  Theorem  4.2:  From  Theorem  3.2  we  know  that 


Q.E.D. 


ip{D0,Kf)  < 


R 1 


A m~(X(T,K,)  ’ 


(A3.7) 


where  R 3  =  max  ||y||2.  Ommiting,  for  the  sake  of  brevity  argument  K.  of  function 
y€&D  r 

X(T,KP)  and  taking  into  account  that 


X(T)  =  Xo„  -  e^BK,)TXooe(A+BK,)TT  f 


where  X^  =  lim  X(T),  the  denominator  of  (A3. 7)  can  be  bounded  as 

T  —■♦oo 

*m,x(X{T))  >  Aro„(X0o)(l  -  ||e<*+*JWT||*)  .  (A3. 8) 

In  [8)  it  has  been  shown  that  A(n„(X00)  >  A’  >  0  defined  in  (4.12).  Therefore, 
to  specify  estimate  (A3.7),  lim||e('4+flAf')T||j  should  be  evaluated. 

With  this  in  mind,  consider  the  realization  (4.2)  with  control  (4.3)  (again,  for 
simplicity  of  notations  we  drop  the  sign  A  in  al’  appropriate  symbols): 


X  = 

*1 

An  ~  ^Ppn 

An  ~  ,Ppii 

ij 

Aji 

A:  j 

Xj 
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where  P*  are  defined  by  the  positive  definite  solution  of  (4.4)  represented  as 


follows: 


Pp  = 


Pun  Pf  12 

PL  P,n 


For  p  sufficiently  small,  (A3. 9)  can  be  analyzed  using  the  singular  perturbation 
approach  (24).  This  results  in 


Pnzi(t)  =  -Pi2X2(t),  Vt>  0  (A3. 10) 


where 


P  n 


lim  — ^r 


lim  . 

yfp 


In  addition,  since  limP,  <  oo,  it  follows  from  (4.4)  that 

fi  — *o 


lim  P9BBtPv  =  lim 

p-~Q  9  v  p—0 


P*n  PpnPpii 
[_  PjiiPpii  PjitPpU 


=  0 


and,  therefore,  P,u  —  Pfu  =  0  as  p  — ►  0.  Denote 


Pn  =  lim  P, 2]  , 

p— o 


P\x 

’  PuP» 

4lim± 

Pin 

P'llPpl, 

.  7r,y.» 

o  p 

PpitPpH 

Then  from  the  above  considerations  it  follows  that 


limiAr/>,  +  P,A  +  /  -  -PpBBtP, ) 

o  p 


•^fi  -^ii 


0  0 
0  Pn 


0  0 


+ 


o  Pn 


Aij 
Ajj  Aj  j 


+  / 
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p\  1 

P11P12 

^2?n 

I  —  Pn  —  0  , 


^Pn  ~  P nP  12  —  0  , 

^ijAi  +  PnAn  +  I  -  pf2P12  =  0  . 

Since  Pf  >  0,  from  (A3. 12)  -  (A3. 14),  respectively,  we  obtain 


Pn  =  I 


> 


p  i2  —  4A 

-^12-^22  +  22^22  +  ^  ~  ^2*421  =  0  , 


Therefore,  from  (A3. 10)  and  (A3.9) 


*i(0  =  -4}iPi2*i(0»  4  >  0 


and 


Xj(t)  =  4X2(0*  t  >  0 


where 


“V 

4  =  —  421 4  jj  ^22  +  422 


(A3. 11) 

(A3. 12) 
(A3. 13) 
(A3. 14) 
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is  a  Hurwitz  matrix.  Thus, 


l\melA+BK'» 

p—*0 


0  ~ATnPneAt 
0  eXt 


and 


II  Um«(A+Bir*)l||,  =  |) «x7V‘  +  eAr‘Pi2A21A[1F22e 

<(14-  ||-P22Aj1Aj'1/>22||2)||e'^<||2  Vt  >  0 


ah 


(A3. 15) 


Therefore,  for  a  >  0  and  0  >  0  satisfying  (4.7),  from  (A3.8)  and  (A3. 15), 

l|mAmax(A:(r,  K,))  >  A*(l  -  ae~2,,T) 


and 

lim V(D0,  K,)  <  --.(i  ~ae_ttT]  if  l-ae-">0  . 
This  provides  the  upper  bound  for  <p(Do,K,). 

To  obtain  the  lower  bound,  we  write 


^mw  {X(T,K,))  <  (*»(*,))  <Tr  *„(*,)  . 


Then,  by  (25), 

liraTr  X„(K,)  =  limTr  CT P,C  =  Tr  CjP^Ct  =  A**  . 

Hence,  by  Theorem  3.1, 

(/?  _  -p-Sa — 

lim  p{Da,K,)>± - ^|MI/  . 

Q.E.D. 
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APPENDIX  4 


Consider  the  closed  loop  system  (1.1),  (1.2)  with 


( A  +  BK )  =  Ae(a,b)  = 


(A4.1) 


If  eA^a'b^x0  €  D  for  V  t  >  0,  the  average  residence  time,  E[rtl)\,  as  estimated  in 


(8),  is 


1 


lim  In  E[tZ0\  =  -  min  yTX001y  > 


2  v&d  ' 


min  yTy 
veep 

2^m*x(-^oo) 


(A4.2) 


where 

AeX *  +  ATooAf  +  CCT  =  0  . 


Since  in  the  case  of  (A4.1) 


AT*  = 


1 

a 

o 


o 

i 

* 


from  (A4.2)  it  follows  that 


£(»■«„  |  >  exp 


b  min  yTy 
ve9D 


if  b  <  a  . 


Therefore,  £(r,0 )  can  be  made  as  large  as  desired  by  an  appropriate  choice  of  b. 
The  residence  probability,  as  it  follows  from  Theorem  2.1  is: 

lime’ In  Prob{rt„  <  T)  =  ~  min  (y  -  e^^l>,xb)rX“l(0(»  ~  eA'(M,lx0) 

o<«<r 
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where 


>  —  -  mm 
-  2  y€OD 

0  <t<T 


II V  -  e*«(«»zo||» 

Ami  „(*(*)) 


1 


X{t)  =  Ae{a,b)X{t)  +  X(t)A*{a,b)  +  CCT,  AT(O)  >  0  . 


If  b 3  <  4a, 


cos6t  +  fsin6t  |sin6t 
—  ---g-  sin  6t  cos  6t  —  j  sin 


where  a  =  6/2  and  6  =  -  6J.  Therefore, 


lim  sup  sup  ||ex«(*»‘||J  =  go  _ 
a-°°  «>0  ||«(1||<1 


Thus,  for  any  open  Do  C  D  with  0  in  its  interior,  T  >  0,  and  6  >  0  there 
exists  x0  and  a  such  that  «*•(*»*  is  arbitrarily  close  to  dD  at  some  t  €  [0,  T ]. 
Then,  as  it  follows  from  (A4.3) 


Prob{r,0  <T}  >  exp  - 


min  || y  -  eA*(a>)x0|| 

V  €00 

o<i<r _ 

2Amin(AT(0) 


is  as  close  to  I  as  desired  and  Prob{r(„  >  T }  small  as  desired. 
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APPENDIX  1 


A*%  0-17 

THEORY  OF  AIMING  CONTROL  FOR  LINEAR  STOCHASTIC  SYSTEMS 

SM.  Meerkov 

Department  of  Electrical  Engineering  and  Computer  Science,  The  University 
of  Michigan,  Ann  Arbor,  MI  48109-2122,  U.S-A. 

T.  Runolfsaon 

Department  of  Electrical  and  Computer  Engineering,  The  Johns  Hopkins 
University,  Baltimore,  MD  21218,  U.S.A- 


Abstract.  The  problem  of  aiming  control  it  formulated  and  solved  Cor  linear  time-invariant 
systems  perturbed  by  small  additive  white  noise.  Both  state  feedback  and  dynamic  output 
feedback  laws  are  considered.  In  tbe  case  of  dynamic  output  feedback,  noiseless  and  noisy 
measurements  are  analyzed.  In  the  noiseless  measurement  case,  it  is  shown  that  the 
fundamental  bounds  on  the  achievable  precision  of  aiming  may  or  may  not  be  finite 
depending  on  the  nonminimum  phase  zeros  and  the  invertibility  of  the  system.  In  the  noisy 
measurement  case  the  achievable  precision  of  aiming  it  shown  to  be  always  bounded. 
Aiming  controller  design  techniques  that  result  in  controllers  compatible  with  the  bounds 
are  developed.  The  approach  is  based  on  the  asymptotic  large  deviations  theory. 

Keywords.  Stochastic  control:  pointing  control;  large  deviations;  first  passage  times. 


INTRODUCTION 

Given  a  dynamical  system  with  states  r  (<) ,  control  u (<) , 
output  y  (()  and  disturbances  {  (t) ,  assume  its  desired  be¬ 
haviour  is  specified  by  a  pair  { ♦ ,  r } ,  where  *  is  the  domain 
to  which  the  output  y(t)  should  be  confined  and  r  is  the 
period  of  the  confinement,  i.e-,  y  (<)€♦,<  €  [0,r|.  For  a 
given  pair  (♦,»■}  we  formulate  the  pair  of  Simmy  central 
as  the  problem  of  choosing  a  feedback  control  law  a,  to  a 
to  force  the  output  y(t)  to  remain,  at  leaat  on  average,  in 
♦  during  period  r,  in  spite  of  tbe  disturbances  f  (t)  that 
are  acting  on  the  system. 

Design  specifications  of  this  form  arise  in  numerous  prac¬ 
tical  control  problem,  e.g.,  telescope  pointing,  beam  point¬ 
ing,  mistle  guidance  and  airplane  landing  These  and  other 
examples  are  discussed  is  Meerkov  and  Runolfsaon  ( 1988). 

Existing  control  '  •axj  does  sot  offer  tools  for  a  direct 
solution  of  thn  control  problem  described  above. 

In  this  paper  a  theory  of  aiming  control  of  linear  systems 
perturbed  by  small  additive  white  noise  is  presented.  Tbe 
approach  is  based  on  the  modem  asymptotic  largs  devia¬ 
tions  theory. 

The  theory  described  in  this  paper  is  an  extension  of 
a  theory  developed  earlier  by  the  authors  in  Meerkov 
and  Runolfsaon  (1988,  1989)  and  RunoUamo  (1989).  In 
Meerkov  and  Runolfsaon  (1988,  1989)  tbs  theory  was  de¬ 
veloped  for  linear  systems  with  small  whits  noise  perturba¬ 
tions  and  state  feedback  control  laws.  In  Runolfsaon  (1989) 
systems  with  noisy  measurements  and  direct  (static)  out¬ 
put  feedback  control  law*  were  considered.  In  the  preronl 
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paper  the  genearal  case  of  dynamic  output  feedback  with 
noisy  (and  noise-bee)  measurements  is  considerd- 

Aa  in  the  earlier  papers  (Meerkov  and  Runolfsson  ( 1988, 
1989))  we  divide  all  stabilizable  linear  systems  into  two 
classes,  weakly  and  strongly  residence  time  controllable. 
Roughly  speaking,  the  system  is  weakly  residence  time 
controllable  (wrt -controllable)  if  there  exists  a  0  <  r*  <  x 
such  that  the  aiming  control  specifications  can  be  satisfied 
by  a  choice  of  u  *  u(r,  *)  for  all  r  <  r*  but  not  for  any 
r  >  r*.  The  system  is  stongly  residence  time  controllable 
(srt-cootroUable)  if  r*  ■  oo. 

Tbe  basic  results,  for  linear  time  invariant  system  per¬ 
turbed  by  mull  additive  white  noise,  derived  in  the  paper 
can  be  summarized  aa  follows: 

1.  A  system  that  has  perfect  (i.e.,  noise- free)  measure- 
menu  is  jrt -controllable  if  and  only  if  the  system  is 
mirntpum  phaet  and  invertible  in  an  appropriate  sense. 

2.  Systems  with  noisy  measurements  are  never  irt- 
coot reliable.  Thus,  the  effect  of  the  measurement  noise 
is  more  detrimental  oo  the  aiming  ability  of  a  system 
than  the  input  noise. 

3.  The  observer  gain  that  ensures  tbe  beat  precision  of 
aiming  is  the  Kalman  filter  gain.  Thus,  the  Kalman 
filter  is  optimal  not  only  with  respect  to  the  standard 
performance  measure  (the  mean  square  estimation  er¬ 
ror)  but  also  from  the  point  of  view  of  the  residence 
time. 

4.  The  controller  gain  that  achieves  the  best  precision  of 
aiming  depends  oo  tbe  optimal  value  of  the  observer 
gain.  Thus,  although  the  separation  principle  docs  not 
lake  place,  the  situation  can  be  characterised  as  a  semi 
separation:  the  optimal  observations  do  not  depend 
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on  the  optimal  control  but  the  optimal  control  doe* 
depend  on  the  optimal  observation*. 

The  paper  i*  organized  a*  follow*:  In  Section  2  we  present 
some  mathematical  preliminaries  and  give  a  presice  for¬ 
mulation  of  the  control  problem.  In  Section  3  an  analysis 
of  residence  time  controllability  properties  is  given  and  in 
Section  4  design  techniques  are  considered.  An  illustra¬ 
tive  example  is  given  in  Section  5  and  conclusion*  can  be 
found  in  Section  6.  Due  to  space  limitations,  all  proofs  are 
omitted  and  are  available  from  the  authors  upon  request. 


U  a  Ki 

dx  »  (Ai  +  Bu)dt  +  L(dx  -  Exdt)  (9) 
if  the  measured  output  ds  »  Exit  4-  tFdv  it  noisy.  Here, 
»(f)  is  a  f -dimensional  standard  Brownian  motion  aud,  as 
before,  0  <  t  <  1. 

For  system  (7)  with  control  (8)  or  (9)  we  consider  the 
following  residence  time  control  formulation  of  the  aiming 
control  problem:  For  a  given  pair  {♦.r}  select  the  pair 
(K,  L)  such  that  the  residence  time  in  *,  t‘  (xo,  u),  satisfies 
f‘(x<t,u)  >  r. 


PRELIMINARIES  AND  PROBLEM  FORMULATION 


Consider  the  following  linear  Ito  system 

dx  —  Aidt  +  tCdw 

y  =  Dx  (1) 

where  z  fi  /f, y  fi  :(t)  is  a  standard  r-dimensional 
Brownian  motion  and  0  <  *  <  1.  Let  ♦  C  Rp  be 
a  bounded  domain  with  the  origin  in  its  interior  and  a 
smooth  boundary  Define 

fie  =  (z  €  fl“|y  =  Dx  6  41} ,  (2) 


fi  =  jz  €  R’lDe^'z  fi  ♦  ,<  >  oj  .  (3) 

Assume  that  z(0)  *  zo  €  Do  and  introduce  the  first 
passage  time 

r'(z0)  =  inf  (t  >  0(y(t,xa)  €  *} ,  (4) 

where  y(t,  xg)  is  the  solution  of  (1)  with  initial  condition 
Xg.  The  following  theorem  was  proven  in  Meerltov  and 
Runolfsaon  (1989)  (aee  also  FVeidlin  and  Wentzell  (1984)). 

Theorem  l:  Suppose  A  is  Hurwitj  and  (A,  C)  is  dia- 
turbable,  i.e.,  rankJC  AC  ■■■  A*_,C]  =  n.  Then  uni¬ 

formly  for  all  zg  belonging  to  compact  subsets  of  fi  we  have 

Um Inf1  (xg)  w  p,  (5) 

€—•0 

where  *'(*o)  *  E».  [r<  (*o)l  »nd 

-  1  Tv 

P  *  "Hi  zV 

*** 2  (0) 
N  m  (VXD7")  ,  AX  +  XA1  +  CCT  »  0. 


Constant  p  is 

of  (1)  in  *. 


referred  to  as  the  logarithmic  residence  time 


Consider  now  the  controlled  linear  system 

dx  m  (Ax  +  Bu)dt  +  tCdie 
ymDx 

where  u  €  /F"  is  the  control.  We  assume  that  there  is 
available  for  control  purposes  a  measured  output  i  6 
and  consider  control  law*  of  the  form 

u  w  Ki 

(S) 

x  m  Ai  -f  Bu  L  (r  -  Ei ) 


Let  y  (t.zg,  zg,  K,  L)  be  the  solution  of  the  deterministic 
system 

[i|  =  f  A  BK  1  M  =  [x°j 

[zj  [LE  A  +  BK-LE)  lz]'[z(0)j  [r0J 
y  —  Dx. 


n  (k,l) 


|y((,  Jg.jg,  Af,L)  € 


>oj 


Then  with  regard  to  control  system  (7)  with  controller  (8) 
or  (9),  Theorem  1  allows  us  to  conclude  that  for  sufficiently 

small  <  and  fi  fi  (K,  L),  the  above  formulation  of  the 

l1®  J 

residence  time  control  problem  can  be  replaced  by  the 
alternative  problem  of  selecting  the  pair  ( K,L )  such  that 

t(K,L)>, i  (12) 

where  p(/C,  b)  is  the  logarirhmic  residence  time  of  the 
closed  loop  system  (7),  (8)  or  (7),  (9)  and  p  =  e>  In  r 
This  is  the  problem  considered  in  this  paper. 

Definition: 

i.  System  (7)  is  said  to  be  weakly  residence  time  control¬ 
lable  if  for  any  bounded  ♦  C  iP(0fi  ♦)  there  exists  a 
controller  (8)  or  (9)  such  that  p(K,  L)  >  0; 

ii.  System  (7)  is  said  to  be  strongly  residence  time  con¬ 
trollable  if  for  any  bounded  ♦  C  R'  ( 0  6  + )  and 
p  >  0  there  exists  a  controller  (8)  or  (9)  such  that 
p(ff,  L )  >  p. 

Throughout  the  paper  we  make  the  following  assumptions: 

1.  (A.C'  it  disturbable, 

2.  (D,A)  it  detectable, 

3.  FFt  >  0,  and  w(t)  and  o(t)  are  independent  Brown¬ 
ian  motions. 

4.  transfer  matrices  G,  (*)  *  D(sl  -  A)-1  B,  G,  (s)  = 
D(tl  -  A)'1  C  and  C,i  (s)  *  E(sl  -  A)~' C  Have 
full  normal  rank. 


RESIDENCE  TIME  CONTROLLABILITY 

In  this  section  we  analyte  the  achieveable  residence  time 
of  system  (7)  with  controllers  (8)  and  (9)  for  the  noiscfice 
and  noisy  measurement  cases,  respectively. 

Let  K  »  (K  6  /T*“*|A  +  BK  is  Hurwitr},  L  = 
{L  fi  /J*"*|A  -  LE  is  Hurwiti)  and  define  the  maximal 
logarithmic  residence  time  of  (7)  in  4*  with  control  (8)  or 

(9)  « 


if  the  measured  output  r  m  Ex  is  noise  bee,  or 


•up  p(A’,L). 

KtK.ltl 


75 


Noise-free  measur""*"** 


We  begin  by  introducing  the  following  hypothesis: 

I.  G,(s)  ia  right  invertible  and  minimum  phase. 

II.  G.i  (j)  ia  left  invertible  and  minimum  phaae. 

HI.  There  exists  an  m  x  r  rational  matrix  V  (a)  with  no 
polea  in  Re  a  >  0  such  that  G«  (a)  +  G,  (a)  U  (a)  =  0. 
IV.  There  exiata  an  p  x  q  rational  matrix  V (a)  with  no 
poles  in  Re  a  >  0  such  that  G%  (a)  +  V  (s)  G.i  (a)  »  0. 

Theorem  t:  System  (7)  is 

a.  weakly  residence  time  controllable  by  controller  (8) 
if  and  only  if  (A,B)  is  stabilizable  and  ( E.A )  ia  de¬ 
tectable; 

b.  strongly  residence  time  controllable  by  controller  (3)  if 
and  only  if  (A,B)  is  stabilizable,  ( E.A )  ia  detectable 
and  either  I  and  IV  or  II  and  III  are  true. 

Remark  t:  In  SISO  case  with  D  =  E,  Theorem  2  implies 
that  for  strong  residence  time  controllability  G,(s)  should 
be  minimum  phaae. 

The  following  resulta,  derived  earlier  in  Meerkov  and 
Runollsson  (1988,  1989),  for  systems  with  state  feedback 
control  laws,  u  »  K *,  can  be  derived  from  Theorem  2. 

Corollary  l:  Assume  that  E  *  /  (the  n  x  n  identity 
matrix).  Then  system  (7)  is 

a.  wrt -controllable  by  controller  (3)  if  and  only  if  (A,B) 
is  stabilizable; 

b.  srt -controllable  if  and  only  if  (A,  B)  ia  stabilizable  and 
III  is  true. 

For  the  special  case  when  the  controlled  output  is  the  whole 
state  vector  we  have: 

Corollary  l:  Assume  D  =  /.  Then  system  (7)  is  srt- 
controllable  if  and  only  tf  (A,  B)  is  stabilizable  and  1m  CC 
Im  B. 

Remark  l:  Note  that  I  ia  a  stronger  condition  than  III. 
Thus,  either  IV  or  II  ia  the  additional  condition  that  has 
to  be  satisfied  when  state  feedback  ia  replaced  by  output 
feedback. 


Noisy  measurements 


Theorem  3:  Let  P  be  the  unique  positive  definite  solution 
of  the  Riccati  equation 

AP  +  PAT +  CCT -PET{FFT)~' EP~  0.  (14) 

Then  the  maximal  logarithmic  residence  time  of  the  cloacd 
loop  system  (7),  (9)  in  9  satisfies 

*  -  VT  {DP°T)  v‘  (15) 


Remark  3:  It  follows,  in  particular  from  Theorem  3  that 
since  the  upper  bound  in  ( IS)  is  always  finite,  system  ( 7) 
with  control  (9)  ia  never  strongly  residence  time  control¬ 
lable.  Therefore,  the  measurement  noise  has  a  greater  lim¬ 
iting  effect  on  the  achieveabte  residence  time  than  the  in¬ 


put  noise  in  (7). 

The  following  theorem  illustrates  that  the  upper  bound  in 
(15)  is  the  best  possible  bound. 

Theorem  1:  The  upper  bound  in  (IS)  ia  attained  if  and 
only  if  there  exiata  a  rational  matrix  W  (s)  with  no  polea 
in  Re  a  >  0  such  that 

Gi  (a)  +  G,  (s)  W  (s)  m  0 

where  G,  (s)  is  defined  sa  previously  and 

Gi(s)  =  G(sf-A)-1i, 

L  =  PEt  (fft)". 


(16) 


(17) 


DESIGN  TECHNIQUES 

In  the  last  section  we  characterized  the  achievable  resi¬ 
dence  time  in  systems  with  observer  baaed  control  laws 
and  noise-free  and  noisy  measurements.  In  this  section  »c 
develop  controller  design  techniques  that  achieve  (or  ap¬ 
proach)  the  maximal  logarithmic  residence  time.  We  will 
concentrate  on  the  noisy  measurement  case  and  illustrate 
how  the  .ioise-free  case  as  well  aa  state  feedback  can  be 
obtained  in  a  similar  way. 


Assume,  for  simplicity,  that  the  domain  *  is  an  ellipsoid 
♦  =  6  R?\yTS]/  <  rJ,5  =  5r  >  o| .  (18) 


Let  W  6  Rf"r  be  a  nonsingular  matrix  such  that  5  = 
WWT.  Then  a  straight  forward  calculation  gives 


2A1BM(WZJ,Y(/t,f,)OrWT)  (19) 

where  A^u  |  )  denotes  the  maximum  eigenvalue  of  a  sym¬ 
metric  matrix  and  X  (K,L)  is  defined  by 


[  * 

BK  1 

\  X(K.L) 

T(K.L)} 

[le  a  + 

BK-LE  J 

[Tt[K,L) 

X(K.L)  ] 

f  X(K.L) 

T(K,L)1 

f  * 

BK  | 

l Tr(K,L) 

X(K,L)\ 

[LE  A  + 

BK-LE] 

0  « 
lfftlt  a0' 


(20) 


From  (19)  *e  conclude  that  a  pair  (K,  L)  is  optimal  if  and 
only  if  it  minimizes  the  largest  eigenvalue  of  I" (A".  L)  = 
WDX  ( K ,  L)  DTWT .  The  following  lemma,  whose  proof 
is  similar  to  the  proof  of  Theorem  2. 1  in  Allwright  and  Mao 
(1982),  characterizes  the  minimum  value  of  A^,.  [T(  A',  L)|. 


Lemma  I:  Let  t  >  0  be  a  scalar,  /  >  l  be  an  integer  and 
select  Kt  €  K  and  l\  €  L  such  that 

TV  r(Ki'Li)1  <(!+#)  inf  Tr  T(A', L)1 .  (21) 

Then 

Um  Am,  (r(ff,.L|)|  -  inf  A*., [T(A\  t)|  (22) 

I- •  n(K,Kl* 
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It  follow*  from  the  lemma  that  in  order  to  minimize 
*nwair(K,  £)),  it  nifficea  to  minimize  TV  r  (A,  A)1  for  I  » 
1,2,3, —  To  accomplish  this  introduce  the  regularized 
“coat" 

j'y(K,L)  =  TV  (r  («•,£)'  +  iKX(K,L)Kt)  (23) 
where  X(A,  A)  is  given  by  (20). 

Lemma  t:  Assume  A7  €  K  and  A7  €  L  minimize 
4  (A,  A).  Then 

lim4(A7.I/)=^inf4LTrr(AM)'.  (24) 


From  Lemmas  1  and  2  we  obtain 


Corollary  3:  Assume  that  the  pair  ( A’,  A7)  e  K  x  L 
minmizes  Jy(K,  A).  Then 

lim  lim  A  (A.7,  A,7)  =  A*-  (25) 

l—OO  T— 0 


A  necessary  condition  for  the  optimality  of  (AT/,  A7)  in  the 
sente  of  minmizing  functional  (23)  is  given  in  the  following 
theorem. 

Theorem  5:  Assume  that  ( A',7,  A’)  6  KkL.  Then  in  order 
for  ( A,7 ,  A7)  to  minimize  Jy  (K,  A)  it  is  necessary  that 

Li  »is  PEt  (FFT)~\  (26) 

K?  =  -l-BTQl  (27) 

where  P  is  given  by  (14)  and 
ATQ1  +  QlA  +  DtWtM]WD  -  1-Q1BBTQ]  =  0,  (28) 

M?  =  i(wd(x?  +  p)dtWtS)'~\  (29) 

(A  +  BK1 )  X,7  +  XI  (X  +  BK1)T  +  LlT  -  0.  (30) 

Since  (14)  has  a  positive  solution,  A7  *  L  €  L.Vy.f.  The 
follosring  lemma  gives  a  condition  for  A,7  €  K. 

Lemma*  3:  Assume  that  A#,7  >  0.  Then  A,7  €  K. 

Remark  4:  It  follows  from  Theorem  5  that  the  optimal 
observation  gam  is  independent  of  the  optimal  control 
whereas  the  optimal  control  gain  depends  on  the  optimal 
observations.  Thus,  a  sezni-separatioo  principle  holds. 

Remark  3:  Tbs  optimal  estimator  (observer)  gain  L  is  the 
Kalman  filter  gain.  Thus,  the  Kalman  filter  is  optimal 
for  optimisation  problem  ( 13).  Furthermore,  consider  the 
equation  for  the  estimation  error  e  m  x  -  i 

de  m  (A  -  LE)edi  +  t(Cdw  -  LFdv)  (31) 

and  denote  the  logarithmic  residence  time  of  t  in  a  bounded 
domain  T  C  11*  (0  6  T)  by  At(L>-  Then 


At  (l)  -  mja  2*Tp''  W  * 
where  P(L)  is  the  positive  definite  solution  of 

( A  -  LE)  P  ( L)  +  P  (L)  ( A  -  LE)t  +  CCT 

+LFFtLt  =  0. 

Since  P  given  by  (14)  satisfies 


P  <  P(A) , VA  6  L, 


we  conclude  that 

A T  (i)  *  min  ~eTP~'e  >  AtW.VA  e  L.  (35) 

Therefore,  the  Kalman  filter  is  optimal  in  the  sense  of 
maximizing  the  logarithmic  estimation  error  residence  time 
in  any  bounded  domain  T  C  BP  (0  6  T). 

Remark  S:  The  optimal  control,  law  for  system  (7)  wall 
noise  free  measurements  and  control  law  (8)  can  be  ob¬ 
tained  from  (26)  —  (27)  by  selecting  F  *  al  and  letting 
a  -*  0.  Indeed,  since  the  optimal  estimator  law  for  (7), 
(9)  is  the  Kalman  filter  we  know  from  the  theory  of  opti¬ 
mal  filtering  that  the  (singular)  optimal  filter  for  (7),  (8) 
is  obtained  in  the  limit  a  —  0  (see,  e.g.,  Kwakemaak  and 
Sivan  (1972)).  Therefore,  the  maximal  logarithmic  resi¬ 
dence  time  for  (7),  (8)  is 

A*  =  hm  hm  lim  A  (A (36) 

where  A,7  ’  and  A,7'"  are  given  by  (26)  —  (30)  with  FFr  = 

a1!. 

Remark  7:  The  state  feedback  controller  that  maximizes 
the  logarithmic  residence  time  of  (7)  in  ♦  can  be  con- 
sructed  in  a  similar  way  as  the  optimal  controller  in  The¬ 
orem  5.  In  particular,  in  this  case  we  obtain  that  the  con¬ 
troller 

u  =  A'7  x,  (37) 


A,  =»  -~BTQl%  (38) 

ATQj  +  <}(7 A  +  DtWtM]WD  -  ^Q]BBtQ1  -  0.  (39) 

M7  .  I  [WDX?DTWTy~' ,  (40) 

(A  +  BA,7)  X 1  +  X,7  (A  +  BA,7)7  +  CCT  =  0  (41 ) 

resulta  in  a  logarithmic  residence  time  ,  A  (a,7),  that 
satisfies 

lim  lim  A  (A.7)  w  sup  A  (A) .  (42) 

l-ao  t-S  \  >  Kt  K 

EXAMPLE 

Consider  the  second  order  system 

0  l]  (0  A  m 

'■  -1  0  '*1  o  *• 

.-(01,.  1,11 
r  *  1 1  0|  *  4-  tFii. 

For  this  system 
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CONCLUSIONS 

It  is  shown  in  this  paper  that  the  fundamental  bounds  on 
the  achMvabla  preosien  of  aiming  of  linear  systems  per¬ 
turbed  fay  whits  noise  depend  on  the  locations  of  nonmini¬ 
mum  phsse  seros  of  the  various  transfer  functions  involved, 
and  on  the  dimensions  of  the  controlled  end  measured  out¬ 
puts  and  control  and  noise  inputs.  Roughly  speaking,  the 
beet  precision  of  aiming  is  obtained  for  minimum  phase 
systems  with  the  number  of  control  inputs  larger  than 
outputs.  Any  desired  residence  time  is  attainable  only  if 
no  measurement  noise  is  present.  Therefore,  the  effect  of 
measurement  noise  is  more  detrimental  on  the  precision  of 
aiming  than  that  of  the  input  system  noise. 
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APPENDIX  2 


Output  Residence  Time  Control 

S.  M.  MEERKOV  and  T.  RUNOLFSSON 

Abstract — Tbe  problem  of  residence  time  coatroi,  Introduced  la  (1|,  I* 
extended  to  systems  with  outputs.  Necessary  tad  sufficient  coaditioas  tor 
output  residence  time  coatrollability  la  linear  systems  with  small,  additive 
noise  are  derived.  State  feedback  coatroilcf  design  techniques  art 
developed  aod  applied  to  a  robotics  coatroi  problem.  The  approach  is 
based  oa  aa  extension  of  the  asymptotic  first  passage  time  theory  to 
output  processes. 


ORIGINAL 

TO  BE  RETURNED 
WITH CORRECTION* 


I.  Introduction 

J 

Given^a  controlled  dynanucal  system  with  states  x(t) 
v  u(t)  €  Ijjft”,  output  y(t)  €5®',  and  disturbances  {(() 

its  desired  behavior  is  specified  by  a  pair  {♦.  t),  where  ♦  C  fil'1  is  the 
domain  to  which  the  outputs  y(  I)  should  be  confined  and  r  ivihe  period  of 
(he  confinement.  i.e..y(f)  6  ♦.  vr  €  (f0.  to  +  r|,  t0  6 .  Problem 
formulation  of  this  form  arises  in  numerous  applications.  For  instance,  in 
the  problem  of  telescope  pointing,  the  domain  *  is  defined  by  the  film 
grain  size  and  r  is  the  exposure  time  (see  [I]  for  additional  examples). 

For  a  given  pair  {♦.  r},  the  problem  of  output  residence  time  control 
is  formulated  as  the  problem  of  choosing  a  feedback  control  law,  so  as  to 
force  y{t)  to  remain,  at  least  on  average,  in  ♦  during  period  r.  in  spite  of 
the  disturbances  £(()  that  are  acting  on  the  system. 

The  purpose  of  the  present  note  is  to  analyze  the  fundamental 
capabilities  and  limitations  of  output  residence  time  control  for  linear 
systems  with  small  additive  perturbations.  The  approach  is  baaed  on  an 
extension  of  the  asymptotic  first  passage  time  theory  to  output  processes. 

The  structure  of  the  note  is  as  follows:  in  Section  II  the  notion  of  an 
output  residence  time  is  introduced:  in  Section  III  output  residence  time 
controllability  is  defined  and  analyzed;  in  Section  IV  output  residence 
umc  controller  techniques  arc  given;  and  in  Section  V  an  example  is 
considered.  The  proofs  are  given  in  the  Appendix. 

II.  Output  Residence  Time 

Consider  a  linear  stochastic  system 

dx  ■  Axdt  a  tCdw 

^  y*Dx  (2.1) 

where  x  €  fW*.  y  €  w(l)  is  a  ttanriard  r-dimenaional  Brownian 
motion  and  0  <  «  <  I  is  a  parameter.  It  ia  aaaumed.  without  loss  of 
generality,  the  rank  D  ■  p. 

Let  ♦  C  be  an  open  bounded  domain  containing  the  origin  and 
whose  boundary  4  t  ia  smooch  and  define 

0,-{*€  ■•|y-Or€  ♦}. 

n«{*  e  n‘\DeA,x  e  ♦.  r*o). 

Assume  that  x9  ■  x(Q)  €  Q«  and  denote  as  y(t,  x0)  the  output  y(t) 
defined  by  (2.1)  with  the  initial  condition  jt«.  Introduce  the  first  passage 
time  of  y(t,  x0)  from  ir  aa  follows: 

r‘(z«)winf  1 1*0  :  y(l.  x»)  €  Hr)  (2.2) 

and  its  mean 

✓•<*>«  £|r'(*)l*|.  (2.J) 

The  calculation  of  f'(xt)  is.  in  general,  a  difficult  task.  To  alleviate  'his 
difficulty,  asymptotic  approximations  with  respect  to  small «  can  be  used 
For  the  special  case  y(t)  •  jr(r)  these  approximations  have  been 
extensively  discussed  in  the  literature  (see.  e  g  .  |l|-|4|  and  references 
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(herein).  An  extension  to  the  more  feneral  case  of  y(t)  »  Dx(t)  is  given 
below  (see  also  (4]). 

Theorem  2.1:  Assume  that  A  is  Hurwitz  and  (A,  C)  is  completely 
disturbable.  i.e.,  rank  [C  AC  •  ■  •  ■  n.  Then  unifonniy  for  ail 

x0  belonging  to  compact  subsets  of  Q  we  have 

lim  t1  In  (2.4) 

<  —0 


where 


;<♦>«  min  \yTNy.  N~(DXDT)-'  (2.J) 

and  AC  is  the  positive  definite  solution  of 

AA+ AAr+CCr-0.  (2.6) 

Proof:  See  the  Appendix. 

The  constant  m(+)  is  referred  to  as  the  logarithmic  residence  time  in 
♦  .  The  properties  of  this  constant,  as  stated  in  Theorem  2.1.  constitute  the 
mathematical  foundation  for  the  analysis  in  Sections  III  and  IV. 

If  y  is  a  scalar,  the  logarithmic  residence  time  can  be  expressed  in  a 
more  traditional  form.  Indeed,  since  in  this  case  ♦  is  an  interval,  say,  ♦ 
»  {-a,  b),  a,  b  >  0,  and  /V  is  a  scalar,  from  (2.3)  it  follows  that 


*!(♦)»  ^  ("»>"  («.  blfN. 


hi’ 


Tr  CTe*T’ DT DeMC 


*Y 


(if.  -  HC.l,-*.  G.(r)-0(s/-A)-'C. 


Therefore. 


;<+) 


min  (a,  *))* 

2#G.li 


(2.7) 


When  y  is  not  a  scalar,  the  simple  relationship  (2.7)  is  not  true.  In  fact,  it 
is  not  difficult  to  show  that  in  general 


.  !»(♦)  at 


min  yry 


21 CA\ 


(2.8) 


III.  output  Residence  Time  controllability 

Consider  now  a  controlled  linear  itnrhaatk  system 

dx-(Ax  +  B*)dt  +  tCdw,  u  6  B" 

y~Dx.  (J.I) 

Let  u  -  Ax  and  let  P(xt,  K)  be  the  mean  first  passage  time  from  ♦  of 
(he  closed-loop  system 


dx  ■  ( A  *  BK)xdt  *  tCdm 

y-Dx  J  (3.2) 

with  initial  conditions  x0  »  x(0)  €  Q*  ■  {x  €  &B*! De*  '***  r?  ♦. 
Tz  0)  .  Define  v 

*(♦.  A)*lim  r*  In  f(Xt,  A).  (3.3) 

.  -« 

Definition: 

i)  The  output  y(0  of  system  (3.1)  is  said  to  be  weakly  residence  ume 
controllable  (y-*n  controllable)  if  for  any  bounded  domain  ♦  c  fjU' 
with  0  m  its  interior,  there  exists  a  control  u  -  Ax  such  that  *(♦,  A )  > 
0. 

ii)  yin  is  said  to  be  strongly  residence  lime  controllable  fy  $r\ 
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it  djm* 


controllable)  if  for  any  bounded  t  CP»  (0  €  t)  and  n  >  0  there  exists 
u  m  Kx  such  that  >!(♦.  K)  2  m- 

The  following  theorem  characterizes  the  class  of  y-wrt  controllable 
systems. 

Theorem  3.1:  Assume  that  (3.1)  has  no  modes  that  are  both 
uncontrollable  and  undisturbaMe.  Then  system  (3. 1)  is  y-wrt  controllable 
if  ( A ,  B)  is  stabilizabie.  If  ( D.A )  is  detectable  then  stabilizability  of  (A, 
B)  is  also  a  necessary  condition  for  y- wrt  controllability. 

Proof:  See  the  Appendix. 

The  assumption  that  (3. 1)  has  no  modes  that  are  both  uncontrollable 
and  undisturbable.  i.e.,  (A,  [5  Cl)  is  a  eemrJtes  pair,  is  assumed  to  be 
true  in  the  remainder  of  the  note.  U  is  made  to  rule  out  some  mathematical 
degeneracies.  Methods  for  relaxing  this  assumption  are  discussed  in  (1). 

Next  we  give  conditions  for  y-srt  controllability.  Define  transfer 
matrices 

G,(.-)*D(s/-A)‘B  (3.4) 


G.(s)-0(s/-A)-'C  (3.5) 

Theorem  3.2:  Assume  (A,  B)  is  stabilizabie  and  (D,  A )  is  detectable. 
Then  (3. 1 )  is  y-srt  controllable  if  and  only  if  there  exists  an  m  x  r  rational 
matrix  U(s)  with  no  poles  in  the  open  right-half  complex  plane  such  that 

C,(s)  +  C,(s)t/(s)»  0.  (3.6) 

Proof:  See  the  Appendix. 

Remark  3.1.  If  G„(s)  and  G,(s)  are  scalars  then  it  follows  from 
Theorem  3.2  that  (3.1)  is  y-srt  controllable  if  and  only  if  all  nonminimum 
phase  zeros  of  G,(s)  are  also  zeros  of  G„(s). 

Remark  3.2:  When  D  is  an  n  x  n  nonsingular  matrix,  i.e. .  when  (3.1) 
has  as  many  outputs  as  states,  condition  (3.6)  becomes  ImC  S  Imfl.  This 
condition  has  been  earlier  derived  in  [I]  (see  also  (4|). 

Although  the  above  results  are  formulated  in  terms  of  multivariable 
systems,  to  simplify  the  situation,  in  the  remainder  of  the  note  we  assume 
that  y.  u,  and  w  are  scalars  and  address  the  following  problems^'  <  — 
Problem  I:  What  is  the  fundamental  bound  on  the  achievable 
logarithmic  residence  time  of  an  output  which  is  not  y-sn  controllable1 
Problem  2:  How  to  design  a  controller  which  results  in  a  desired  output 
logarithmic  residence  time? 

We  give  the  solution  to  Problem  1  in  this  section  and  to  Problem  2  in 
Seaton  IV. 

Lct.A  »  { K\A  +  BK  is  Hurwitz}  and  define  the  maximal  logarithmic 
residence  time  in  ♦  by 


m*(+)*  suo  »»(♦,  A). 

-  £  - 


su  omit.  A). 


Obviously.  #**<♦)  ■  •  for  a  y-srt  controllable  output.  Let  z, ,  •  •  •,  i,  be 
the  open  nght-half  plane  (rhp)  zeros  of  G,(j). 

Theorem  3.3:  Assume  (A,  B )  is  stabilizabie.  Then  >»*(♦)  is  given  by 

_  (min  («.  b))1 

210.1“'  <3  8> 


n(t>o 

>•  i 

where  i,  is  the  complex  conjugate  of  z,  and  q(J)  is  the  unique  polynomial 
of  degree  less  than  /  determined  by  the  interpolation  constraints  at  each 
rph  zero  ;  of  G,(J)  of  multiplicity  m,  Ga(r)  satisfies 

d‘  d‘ 

—  Ga(s)|..,»— G.(s)|,.,.  k-o.-'-.m- I.  (3.10) 
Proof:  Sec  the  Appendix 

Remark  3.3:  The  function  G,i(j)  defined  by  (3  9)  is  the  rational 
function  of  minimum  H-  notm  which  satisfies  the  interpolation  con- 
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strain's  (3.10)  [3],  (6].  Thu*,  the  problem  (3.7)  is  equivalent  to  the 
problem 

min  { Q £7 H j  :  O(s)  €  H1,  C(s)  rational} 

subject  to  the  constraints  (3.10).  On  the  other  hand,  the  //'-optimal 
transfer  function  (7]  which  satisfies  the  interpolation  constraints  (3. 10)  is 
an  all  pass  filter,  i.e..  constant  in  magnitude  on  the  ju-txis.  Thus,  an 
unweighted  //“-optimal,  stabilizing  state  feedback  controller  (8|  leads  to 
a  closed-loop  system  with  the  shortest  possible  logarithmic  residence 
time. 

The  formula  (3.8)  for  *»*(♦)  simplifies  considerably  when  the  rhp  zeros 
of  G,(s )  are  distinct.  Define  an  /  x  /  matrix  Z  by  t,,  ■  (z,  +  f,)'1.  1  s 
/,  j  s  /,  and  an  /j^Kcolumn  vector  g  by  g,  ■  G.{z,).  j  »  I .  •••,/. 

—  Theorem  j. /.  Assume  that  the  rhp  zeros  of  G,(s)  are  all  distinct.  Then 


>»•(*) 


(min  (a.  b))1 
2g»Z-'g 


where  gH  is  the  Hermitian  transpose  of  g,  i.e..  gH  -  gT. 
Proof:  See  Appendix 


(3.11) 


iv.  Output  residence  Time  Controller  Design 

In  this  section  we  give  a  method  for  selecting  a  controller  which  results 
in  any  admissible  logarithmic  residence  time  ji  <  u*(+). 

Recall  that  **(♦,  K)  is  given  by 

m(*.  /0-i(min(e,  b))lN{K).  (4.1) 

Thus,  the  maximization  problem  (3.7)  is  equivalent  to  the  minimization 
problem 


inf  DX(K)DT.  (4.2) 

X€X 

Since  the  equation  which  X(K )  satisfies  is  linear  in  K,  it  is  easy  to  see 
that  the  infimum  (4.2)  is  not  attained  at  any  K  €  K.  Thus,  »»•(♦)  is  not 
attained  for  any  K  €  If.  We  now  construct  a  sequence  of  controllers 
whose  logarithmic  residence  times  aovenge  to  <»•(♦).  Let  Kt  6  K  and 
define  a  regularized  •‘cost"  - - 

DX(K9  +  K)DT  +  yKXiKt  +  K)KT,  y>0.  (4.3) 

Obviously. 


,!(*.  A'0+ A)i 


(min  (e,  b))* 

U,iK) 


K  €  K. 


(4.4) 


It  is  well  known  from  the  theory  of  optimal  control  (9)  that  J,{K)  is 
minimized  by 


(4.5) 

where  Qy  is  the  positive  scmtde finite  solution  of 

(A  *BX,)rQy  *  Q,(A  +  BK,)  +  DrD-~  Q,88rQ,~0.  (4.6) 

7 

The  following  theorem  can  be  proved  using  the  results  of  |9|. 

Theorem  4.1: Assume  {A.  B)  is  stabilizable.  Then  *•(♦.  Kt  *■  K')n 
nondccrcasmg  as  y  —  0.  and 

lim  ;<♦.  *,♦  *’)«>»•<♦). 


v  Example 

Example  5  I:  Consider  (he  problem  of  controlling  the  tip  position  of  a 
flexible  robot  arm  using  control  torques  applied  at  the  robot  arms  hub 
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[10],  A  finite -dimensional  approximate  model  for  a  robot  arm  which  is 
flexible  in  the  horizontal  plane  but  not  in  the  vertical  plane  or  in  torsion 
was  described  in  110).  The  model  is  described  by  the  following  set  of 
equations: 

0  I 
-UP,1  -2f,u>, 

y,»[0,a)  0]*,,  i-0.  1.  -.n  (5.1) 


where  f.  is  the  length  of  the  arm.  f,,  u,,  and  d,(z)  (z  €  [0,  L])  are  the 
damping  coefficients,  pinned-frec  frequency,  and  modal  gain,  respec¬ 
tively.  of  (he  ith  mode  of  oscillation,  lT  is  the  tout  moment  of  inertia,  u  is 
the  control  torque,  f  is  a  random  torque  acting  on  the  tip,  and  y  » 
is  the  tip  position. 

Assume  that  it  is  desired  to  maintain  the  (ip  position  within  the  bounds 
-a  £  y  £  b  during  a  specified  time- interval.  T,  and  assume  that  the 
disturbance  (  can  be  modeled  as  a  small  white  noise  « w. 

The  system  transfer  function  for  (5.1)  is 


G,(r) 


It  “  s1  +  2f,ui,.l  +  ui1 


d0>,(  0) 


(5.2) 


and  the  noise  transfer  function  is 


G.(s)- 2 

i«0 


*!axs+2  r,u.,) 
i1+-2f,up,s  +  <<»1 


(5.3) 


It  was  indicated  in  [  10]  that  taking  n  *  3  gives  a  good  approximate 
model  and  the  values  of  the  constants  f„  ui,,  *,(L),  d  *,(0 )/dz  and  h 
were  determined  experimentally.  The  resulting  system  has  three  right 
half-plane  zeros  at  Zi  *  12.04  and  Zu  *  21. J  ±  j  25.3.  ft  is  easily 
checked  that  G.(Zi)  *  0.  Thus,  system  (5.1)  is  not  y-srt  controllable. 
However,  it  is  controllable  and.  thus  y-wrt  controllable  and  the  maximal 
logarithmic  residence  time  can  be  obtained  from  (3. 1 1)  to  be 


(min  («.  ft))1 
UHZ't 


(mm  (a,  b))1 
2(0.046) 


10.87  (min  (a,  b))1. 


(5.4) 


Thus,  any  specified  time-interval  (0,  71  has  to  satisfy  the  bound 


In  T S 


10.87  mm  (a.  b))1 


(3.5) 


Appendix 

Proof  of  Theorem  3.1:  First  note  that  it  follows  from  the  definition 
of  0,  mat 

inf  {f*0|/(i)  €  *t}-inf  |f*0|x(/)  6  «.}•  (A  D 


Therefore. 

fix*  t)-£  [inf  {/x0|y(f.  **)  € 

»  £  |inf  { r*0|x(f,  *•)  €  3Q»|x»l  *  *'(•*».  %)■  (A  2) 

Now.  it  follows  from  (4.  Theorem  4|  that  uniformly  for  x9  belonging  to 
compact  subseu  of  Q  we  have 

lim  «!  In  f*(x».  Q»)*0(Q»)“  min  -xTMx  (A. 3) 

-•  !(««< 

where  M  ■  X ‘ '  and  X  is  given  by  (2.6). 

To  complete  the  proof  we  show  that  ♦(!)«)  *  **(■♦)-  Let  x  ■  Tibet 
nonamgufar  change  of  coordinates  that  maps  (2.1)  into  the  form 

d  [*’1  -T  'A  Txdt  ♦ «  7  Cdw 
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-[£  t]  [i]  —  [c] 

y.DTi-OSm[I  0] 


(such  a  T  always  exists  since  rank  D  »  p).  Under  this  change  of 
coordinates  M  is  mapped  into  A?  ■  Tr  AST  and  the  domains  Qo  and  0 
become 

flo-ji  6  €  *J, 

6  Jl’\y*0eA,i,  6  *,  taO}.  (A.3) 

The  logarithmic  residence  time  in  ft0  is  now  given  by 

0(0,)-  min  " 

-^minjlirin  [^v  &][j]  (A6) 

x 2  free 

We  minimize  first  with  respect  to  the  unconstrained  variables  i2  giving 
i2- -AJjj'A?^,.  (A.7) 

Substituting  (A.7)  into  (A.6)  and  rearranging  gives 

0(0,)-  mm  ii.lAJu-AJ.jAJa  A?^|i,.  (A.8) 

i,€*t  2 

The  matrix  A?„  -Mm  AS^'  A?f2  is  exactly  where 


Therefore. 


1*^ 


O(0i) »  min  ^  ifJ? ,,  J?i. 
»,€*♦  * 


r 


However.  Xu  -  /5^f3rand  therefore 

0(0.)-  mm  \t\(0X0TY'*\-  (A- 10) 

*,€**  * 

Finally,  substituting  back  the  original  coordinates  gives  6X0r  - 
DTT  '  X(TTY'  TTDr  -  D*0r.  Thus 


0(0.) -<£(♦)■  min  s/rAf/- 

s 


Q.E.D. 

Proof  of  Thtorwm  3.1:  The  sufficiency  pert  of  the  theorem  follows 
directly  from  (I.  Theorem  3.IJ. 

To  prove  the  necessity  note  dial  /-wrt  control  lability  implies  that  there 
exists  a  control  u  -  Kx  such  that  DX(K  )Dr  >  0.  Assume,  w.thout  loss 
of  generality,  that  the  closed-loop  system  has  the  Kalman  canonic  form. 


X,,  0  Xi,  0 

.  av  I  ^11  XU  XU  X„ 

A +  BK*  A*  0  0  0 

0  0  Att  Am 


.  0-10,  0  0,  0| .  1A  12) 


The  subsystem 
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([£  <?.]  •  [»]) 


U  control  Uble  and  the  detectability  o HD,  A)  implies  that  Au  is  Hurwia. 
If  we  can  show  that  A, j  is  Hurwia.  the  proof  is  complete. 

Note  that 

Dxmn’.fO,  0.1  [ J;  <*.«> 

where  X,,,  1  Si,./'  s  4  is  a  decomposition  of  X(K)  compatible  with 
(A.  12).  Also,  A  satisfies  the  Lyapunov  equation 

A*  +  *Ar  +  CCT~0  (A.  14) 


['o  t]-  *-[§] 


The  pair  (0.  A)  is  observable.  Therefore,  by  (II.  Corollary  1)  all 
eigenvalues  of  A  in  Re  s  2  0  are  undisturbable.  However,  since  (A,  ( B 
C])  is  controllable,  we  can  assume  that  (A  +  BK,  C)  is  a  disturbable  pair 
(otherwise  an  arbitrarily  small  change  in  K,  say  6K,  will  render  (A  + 
B{K  +  4/0,  C )  disturbable  (121).  Therefore.  (A,  C)  is  a  disturbable 
pair  and.  thus.  A  is  Hurwia.  Q.E.D. 

Proof  of  Theorem  3.2:  The  proof  is  a  simple  application  of  the 
results  in  [9|  and  (131.  It  is  easy  to  show  that  _ _ 

min  yry  p  Jua  yTy 

2T rDX(K)DrS>l(*’  K)SiTrDX{K)Dr  '  (A  15) 

Thus,  y-srt  controllability  is  equivalent  to 

inf  Tr  DX(K)DT mQ.  (A. I6> 

K€K 

It  follows  from  the  results  of  (9|  that 


inf  Tr  DX(K)Dr~\im  Tr  DX(K',)DT 

K€K  »-• 


Furthermore, 


A  rQ,  «■  Q,  A  +  D  rD  -  -  Q,BB rQ,  -  0. 


lim  Tr  OJIf(lf’)Or-  lim  Tr  CrQ,C. 


Thus,  it  follows  from  (A.  17)  and  (A.  IS)  that  (3.1)  is  y-sn  controllable  if 
and  only  if 

lim  c,rC,c."0,  f»l.  -  .r  (A. 19) 

T  “S 

e.c. 

where  C  •  [c,  ■  g,\  Now  by  (13.  Theorem  l|.  (A.  19)  is  true  if  and 

only  if  there  exist  rational  m- vectors  u,(s), »  ■  I .  .  r,  with  no  poles  in 

Re  s  >  0  such  that 


D(i/-A)  '|0u,(r)>c.l-O.  «-l. 


or  equivalently 


G,(t)U(t)*G,{s)mQ 


where  C/(s)  -  |u,(j)  u,(j)|  QED. 

Proof  of  Theorem  3  3:  We  know  from  (2.7)  and  Theorem  4  I  that 

,  (mm  («,  p)); 

m  <♦) * hm — r-—, —  (A  21) 

2H  C,  J  j 
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where 

G,(j)  -  G.(s,  Xy)  -  Dili-  A-BK,)-'C.  (?,«*,+  K\  (A.22) 

Note  (hat  G,(r)  can  be  rewritten  a* 

Gy(s)~D(sl-A-B/ty)-<C 

-  D[l- (si -A)- '  B/ty\ -  '(si- A )- 'C 
•  D[l+(sl-A-BXy)'BKy\(sl-AV'C 
- D(sl-A)-'C  +  D(sl-A-BX,)-'BX1(sl-A)-‘C .  (A.23) 


D(sl-A)-'C-°-£\ 

d(s) 

(A.  24a) 

D(sl-A-B*yr'B-£\ 

(A. 24b) 

dy(s) 

*y«l-Ar'C.$g 

(A. 24c) 

and  note  that  dy(s)  »  det  (si  -  A  -  is  Hurwitz  for  all  7  >  0  and 
my(s)  m  adj  (si  -  A)C  is  a  polynomial  of  degree  less  than  n.  Then 
(A.23)  becomes 


a(s)dy(s)  +  n(s)m,(s) 

c'{s) " - dMS&i - 


(A.24d) 


Note  that  dy(s)  is  the  denominator  polynomial  of  G,(r);  therefore.  d(s) 
divides  a(s)dy(s)  *■  n(s)my(s)  for  ail  7  >  0.  Write  n(j)  »  n,(s)n,(s) 
where  n,(s)  has  zeros  only  in  Re  s  S  0  and  n,(s )  has  zeros  in  Re  s  >  0 
only  It  can  be  shown  that  \fy  dy (s)  —  n,(s)n,(  -  s)  as  y  —  0(14]  and 
Ky  -  X  as  7  -  0  (9].  Thus. 


Go(s) » lim  G,(s) 
♦  —0 


a(s)n,(s)n.(-s) »  n,(j)n.(s)m«(s) 
d(s)n,(s)n,(-s) 


a(s)n,( -s)  +  n,(s)m*(s) 
d(s)n,(-S) 


(A.23) 


where  m0(s)  ■  £  adj  (j/  -  A)C.  From  the  previous  discussion  we 
know  that  a(s)n,( -s)  +  n,(s)m9(s)  »  d(s)q(s)  for  some  polynomial 
</(s).  Furthermore,  since  the  degrees  of  e(j)  and  m«(J)  are  less  than  « 
and  n,(s)  has  degree  f,  it  follows  that  q(j)  has  degree  leu  than  I. 

It  follows  from  (A. 25)  that  G«(s)  satisfies  the  constraints 


G«(s)|,.,w~C.(J)L.,.  *»0.---.m-l  (A. 26) 

at  each  nonminimum  phase  sore  of  C,(s)  of  multiplicity 
^  Therefore-:  ' - - - - 


and  q(s)  is  uniquely  determined  by  (A. 26).  Q  E  D. 

Proof  of  Theorem  3,4:  By  assumption,  the  nonminimum  phase 
zeros  of  G,(j)  arc  distinct.  Therefore,  we  can  rewrite  Ga(s)  u 

c,u)«2r^  <A28) 

/•i  * 

where  tr  j  »  l.  ,  /  are  some  constants.  At  each  s,  we  have  (from 
<3  I0)| 


C.U.) 


C.(t)«g. 


(A  29) 


Thus.  (A  29)  gives  /  equations  which  can  be  written  in  mains  notation  as 
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Zl-f 


(A.  30) 


where  tT  -  (/,.•••.  t,)  and  Zand  |«  defined  as  previously. 
Next  we  calculate  It  Col}. 


IColl}-^  |G»(/»>I2*' 

m±[m  — 


yu 


,yif  _ ‘A - *, 

Za  2r  J-.  Uy+ywXt-yu) 

I 

.  y  _L  r  _ ii - -  ds.  (a. 3i> 

Za  2»y  3  -y  l2,+yXz.-i)} 

r^-l 

Using  the  calculus  of  residues  to  evaluate  the  integrals  appearing  in  (A .  3 1 ) 
r  - ii - di-2rj-^-.  (A. 32) 

3  (*y  +  rXt.-s)  i  + 


gives 


Thus 


(A. 33) 


Substituting.  /  -  2-'*  from  (A.30)  (note  that  Z  is  an  invertible 
Hcrmman  matrix)  gives 

(A.  34) 


and  (3. 1 1)  follows  from  (A.34)  and  (3  8). 


Q.E.O. 
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